-- Logs begin at Thu 2022-08-18 19:36:28 UTC, end at Thu 2022-08-18 21:26:38 UTC. -- Aug 18 20:51:52.954758 dv-osbrick-849017-5-ceph systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 20:51:52.965152 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:51:52 2022] *** Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: nodename: dv-osbrick-849017-5-ceph Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: machine: x86_64 Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: clock source: unix Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: pcre jit disabled Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: detected number of CPU cores: 4 Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: current working directory: / Aug 18 20:51:52.967191 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: your processes number limit is 47680 Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: your memory page size is 4096 bytes Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: detected max file descriptor number: 2048 Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: lock engine: pthread robust mutexes Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: thunder lock: enabled Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 20:51:52.967852 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:51:53.013266 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: Python main interpreter initialized at 0x55b34ecd69c0 Aug 18 20:51:53.013266 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: python threads support enabled Aug 18 20:51:53.013266 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: your server socket listen backlog is limited to 100 connections Aug 18 20:51:53.013266 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:51:53.013645 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:51:53.013727 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: *** Operational MODE: preforking *** Aug 18 20:51:53.013970 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:51:53.013970 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: spawned uWSGI master process (pid: 88574) Aug 18 20:51:53.014182 dv-osbrick-849017-5-ceph systemd[1]: Started Devstack devstack@keystone.service. Aug 18 20:51:53.014747 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: spawned uWSGI worker 1 (pid: 88585, cores: 1) Aug 18 20:51:53.015080 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: spawned uWSGI worker 2 (pid: 88586, cores: 1) Aug 18 20:51:53.017720 dv-osbrick-849017-5-ceph devstack@keystone.service[88574]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:51:57.769846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:57.769846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: from cryptography.utils import int_from_bytes Aug 18 20:51:57.770612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:57.770612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: from cryptography.utils import int_from_bytes Aug 18 20:51:57.775519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:57.775519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: from cryptography.utils import int_from_bytes Aug 18 20:51:57.775993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:57.775993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: from cryptography.utils import int_from_bytes Aug 18 20:51:57.821449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:51:57.821653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:51:57.821789 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] command line args: [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:51:57.822119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:51:57.822232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ================================================================================ {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:51:57.822481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] admin_token = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.822721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] config_dir = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.822907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.823087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] config_source = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.823264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] debug = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.823460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.824645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.824645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.824787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:51:57.824859 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.824919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:51:57.824983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] command line args: [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:51:57.825109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:51:57.825234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_config_append = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ================================================================================ {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:51:57.825361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_dir = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] admin_token = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_file = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] config_dir = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.825880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] config_source = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] debug = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.826921 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827080 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827080 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_config_append = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827711 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827804 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.827921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_dir = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_file = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828608 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.828796 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829153 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] publish_errors = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829810 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.829975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] standard_threads = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830772 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.830922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831279 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] use_journal = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] use_json = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] use_stderr = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.831934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] use_syslog = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] publish_errors = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.832577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.832771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.832937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.833112 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.833191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.833268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.833395 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] standard_threads = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.833493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.833646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.833821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.833902 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.834109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.834232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] use_journal = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834349 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.834489 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] use_json = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] use_stderr = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.834727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] use_syslog = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.834834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.834913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:57.835067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835314 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835569 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.835818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.836480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.836611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.836736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.836851 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.836977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837107 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837866 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.837986 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838425 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838762 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.838928 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839615 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839693 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839851 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.839932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840163 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.840895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841147 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841318 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.841894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842358 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842586 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.842967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843279 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843422 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.843984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844221 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.844909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845134 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845374 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845514 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.845999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846315 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.846992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847112 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847296 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847534 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.847999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848080 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848240 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848566 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.848942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.849924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850245 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850631 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850872 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.850959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.851119 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.851197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.851352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.851432 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.851645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.852940 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853414 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.853935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854239 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854641 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854728 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.854956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855658 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.855884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856035 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856583 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.856969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857049 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857719 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.857992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.external = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858832 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.858972 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859258 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859384 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.password = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859801 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.859943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] auth.token = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860496 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.860934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.external = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861500 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.861668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.866865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.866865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.password = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] auth.token = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867534 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.867990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868175 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868687 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.868990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869825 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869904 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.869978 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870133 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870208 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.870965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871554 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871634 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871708 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871789 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871869 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.871944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872749 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.872975 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873912 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.873988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874067 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874141 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874213 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874293 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874892 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.874964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875192 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875637 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.875935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876439 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876512 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876586 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876816 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.876962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877424 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877796 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.877951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878187 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878416 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.878965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879214 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.879912 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880131 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880751 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.880996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.881965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882059 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882772 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.882997 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883158 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883237 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883631 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.883992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884120 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.884920 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885291 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885370 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.885850 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886250 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886333 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.886985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887765 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.887998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888153 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888233 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.888918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889644 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.889896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890358 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890744 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.890980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891061 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] role.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891525 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] role.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.891997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892239 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892391 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892738 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.892965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893419 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.893974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894208 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] role.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] role.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.894922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895077 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895159 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.895978 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896059 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896799 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.896948 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.897790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.901979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902174 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902610 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902900 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.902973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903119 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903192 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903273 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903349 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903422 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903641 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.903942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904244 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904616 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904764 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.904982 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905066 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905141 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905358 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905426 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.connection = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905872 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.905945 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906472 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906628 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.906999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907147 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907616 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.connection = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.907995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908069 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908691 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.908849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:51:57.908921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.909151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.909387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.909649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.909888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.910135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.910373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.910620 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.910855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.911101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.911333 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.911576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.911812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:57.911984 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:51:57.938919 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.939143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.939367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.941147 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.941377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.941622 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.948545 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.950855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.979350 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.979528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.979646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:57.979727 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.032900 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.033245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.083315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.083553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.084292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.084530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167323 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.167983 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.168067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.168194 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.168278 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.197944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.198659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.209389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.209917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228396 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228492 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228719 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.228945 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229472 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.229705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88585) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:58.246260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.246469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:58.246817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.246901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.247017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:58.247099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:58.247288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.247371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.247548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.247632 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:58.247806 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.247888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.248063 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.248145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.248337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.248599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.257550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.258398 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.258671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.258797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.258954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.259084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.259359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.259643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.265894 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.266722 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.269030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.269311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.269601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.269908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272303 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.272390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.272970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273199 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273346 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.273442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.300926 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.300926 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.300926 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.301160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.301160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.301160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.301494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.301801 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.302085 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.305631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.305914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.306318 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.310675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.310963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.312771 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.313060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.314992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.315278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.315562 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.315848 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.316126 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.316528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.316803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.317085 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.317174 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.317380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.317695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.318100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.318389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.318677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.323935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.323935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.332721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.332995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.334701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.334989 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.337411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.339804 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.340550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.340848 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.342937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.343359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.348993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.349208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.349466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.350974 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.353167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.353486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.353801 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.354095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.354375 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.354732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.354817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.355040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.355333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.355733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.356027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.356333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.370808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.371091 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.371355 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.371619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.372269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.372567 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.372843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.373126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.378326 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.379977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.380065 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.380253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.381781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.382071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.383000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.383496 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.383496 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.383807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.384040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.384820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.385112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.385402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.385734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.386029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.395617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.395900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.396180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.396461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.396743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.397020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.397306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.397692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.397984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.398273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.399071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.399360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.399642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.399932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.413210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.416124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.416974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.419180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.420002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.421454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426330 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.426330 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426330 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.426506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.426506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.429963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.431429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.432372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.433897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.434370 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.434659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.434944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.435221 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.436797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.437094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.437387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.437715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.443150 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.443438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.443720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.446918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.447209 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.447497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.450874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.452225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.452514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.452802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.453094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.453368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.453665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.453960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.454222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.454494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88585) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:58.454591 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.454784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.454868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455319 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455468 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455582 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.455748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.456029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.456308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.456596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.456869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.457159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.457436 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.457726 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.458063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.458338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88585) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:58.489747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b34ecd69c0 pid: 88586 (default app) Aug 18 20:51:58.492500 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b34ecd69c0 pid: 88585 (default app) Aug 18 20:51:58.493272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b73376-52e6-419d-8082-a20947616951 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.493563 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b73376-52e6-419d-8082-a20947616951 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.493859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b73376-52e6-419d-8082-a20947616951 None None] PATH_INFO: `/v3` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.497972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Aug 18 20:51:58 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:06.797092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.797653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.797653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.801811 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:06.807470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.807857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.808014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.883561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: INFO dbcounter [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] Registered counter for database keystone Aug 18 20:52:06.905164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG oslo_db.sqlalchemy.engines [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:06.911327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writer thread running {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:07.093124 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG passlib.handlers.bcrypt [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88586) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:52:07.093469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG passlib.handlers.bcrypt [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88586) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:52:07.148599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:07.150270 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:07.302961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:52:07.823993 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.905787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: INFO dbcounter [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] Registered counter for database keystone Aug 18 20:52:07.925904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG oslo_db.sqlalchemy.engines [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:52:07.932898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writer thread running {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:52:08.080078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310b262-fc64-48a8-8c45-ce7010f8e463 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.084234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.084852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.085130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.085396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.094396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.145554 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:52:08.145912 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb4e3c2-07b0-4a4d-a4be-17f527921ee3 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.156555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 20:52:08.162437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.177512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73866df6-5b2f-4206-83f3-f752e75b30ee None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.182226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.183333 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.183614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.183883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] PATH_INFO: `/v3/projects/adeaf2e8d52b44768681465c037dfd4a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.187699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] RBAC: Authorizing `identity:get_project(project_id=adeaf2e8d52b44768681465c037dfd4a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.237997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING keystone.common.rbac_enforcer.enforcer [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:52:08.238338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922b937c-df24-4a6b-8b6e-8bc3ac8df2dd admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.242971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/projects/adeaf2e8d52b44768681465c037dfd4a => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:10.443174 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8cfe-4b16-45a2-9ae7-6cb63d1de2d2 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.443781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8cfe-4b16-45a2-9ae7-6cb63d1de2d2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.443884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f8cfe-4b16-45a2-9ae7-6cb63d1de2d2 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.448531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:10.454132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.454565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.454657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.476724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:10.478479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:10.486865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:52:10.814667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f8cfe-4b16-45a2-9ae7-6cb63d1de2d2 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:10.826772 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f8cfe-4b16-45a2-9ae7-6cb63d1de2d2 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:10.831082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:10.831683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.831967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.832277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.840110 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:10.841926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d69aba-880e-4a3b-b9cb-43c21e22da00 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:10.850709 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Aug 18 20:52:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:52:10.856842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:10.866002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebfe73-d665-442c-9474-744c340e6087 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:10.871106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:10.871724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.872008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.872284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.873590 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:10.875449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952b99b-e8ce-4826-9a31-48b329445a41 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:10.876983 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Aug 18 20:52:10 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:13.108332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9566999-b5b6-4926-9cd5-7dcfb73f401d None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.108871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9566999-b5b6-4926-9cd5-7dcfb73f401d None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.108871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9566999-b5b6-4926-9cd5-7dcfb73f401d None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.110248 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:13.115470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.115894 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.116017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.133719 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:13.134905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:13.194180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413249d-562f-4b2a-a0fd-614e7be1efb7 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.194464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413249d-562f-4b2a-a0fd-614e7be1efb7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.194734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413249d-562f-4b2a-a0fd-614e7be1efb7 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.196065 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 6/11] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:13.201842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.202122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.202406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.222225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 6/12] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:13.245624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG passlib.handlers.bcrypt [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=88585) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:52:13.246044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG passlib.handlers.bcrypt [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88585) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:52:13.292446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:13.294162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:13.401165 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 7/13] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:13.546881 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.570763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.728119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.766900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db7b16-3e39-4b9c-8268-729075b0a0f0 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.801710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.802336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.802615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.802887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.814770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:13.823492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:13.824479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:13.825752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 7/14] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:13.830584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.832449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74575262-4a7c-4118-9d1f-3db993ce8d8e None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.834810 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.873109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.874040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.874570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.874908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.914116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.933522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a5201-23ab-4b41-a55a-939ccb9c8ccf None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.952724 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.954246 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.981162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.981739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.982026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.982294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.982994 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:13.983295 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.984744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.998269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 8/15] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:14.003962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.067672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 8/16] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:14.073398 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.077831 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.106812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2595-c315-46b4-991e-5bfd29b6650a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.142465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.143123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.143363 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.143634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.144782 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.146681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.148200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 9/17] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:14.153777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.169653 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.177407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd79d9-3b8b-490c-a791-8651a658b8ee None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.213405 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.214370 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.214651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.214924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.233651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.235068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:14.255406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:14.256395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:14.257208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:14.257208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:14.257208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:14.257208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 9/18] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:14.257820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00121553-3607-4faa-83c0-89f7561e3104 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.262964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.298492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.299155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.299434 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.299706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.300942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.302481 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.304122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 10/19] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:14.310818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.402010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.421848 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dbe75-ed98-4cbd-8670-2165be7b743e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.431609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.459165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.459754 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.460029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.460300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.461061 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.domain.id=default, user.id=4b130916f4b143099f2974e99dac365a) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:14.461364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.463073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74b079c-00a3-4a6d-9db7-b1656a202f4d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.470602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 11/20] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/role_assignments?user.id=4b130916f4b143099f2974e99dac365a&scope.domain.id=default&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:14.481957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f28b4d-11ef-4ae4-bd98-5dc99704d472 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.519975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.520500 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.520777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.521342 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.522042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:14.522344 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.523774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb45-02c6-4a4b-8010-61368ed36aad None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.544461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 10/21] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:17.155585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958502c9-05fd-4c00-a0b0-7b6e00462a0b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.156092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958502c9-05fd-4c00-a0b0-7b6e00462a0b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.156167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958502c9-05fd-4c00-a0b0-7b6e00462a0b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.157442 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 12/22] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:17.162987 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b6b-05cb-4270-ba76-6decd3f50296 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.163925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b6b-05cb-4270-ba76-6decd3f50296 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.164393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da78b6b-05cb-4270-ba76-6decd3f50296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.194561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-3da78b6b-05cb-4270-ba76-6decd3f50296 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:17.196642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-3da78b6b-05cb-4270-ba76-6decd3f50296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:17.290915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:17.367754 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178199e-da38-4f33-bfc5-7105d2f9abcd None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.367754 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178199e-da38-4f33-bfc5-7105d2f9abcd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.369892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c178199e-da38-4f33-bfc5-7105d2f9abcd None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.369892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:17.370180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ed82-d595-4990-9cdc-2c4a0a9131fb None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.370286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ed82-d595-4990-9cdc-2c4a0a9131fb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.371105 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0ed82-d595-4990-9cdc-2c4a0a9131fb None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.372550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 12/25] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:17.377091 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db26ec-b88a-4053-822c-15f9f1235d70 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.377593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db26ec-b88a-4053-822c-15f9f1235d70 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.377776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcd59-e5b5-4276-8531-9a896b35f7cb None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.378097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db26ec-b88a-4053-822c-15f9f1235d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.378528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcd59-e5b5-4276-8531-9a896b35f7cb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.379000 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bfcd59-e5b5-4276-8531-9a896b35f7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.407550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-25db26ec-b88a-4053-822c-15f9f1235d70 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:17.408708 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-25db26ec-b88a-4053-822c-15f9f1235d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:17.409116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-22bfcd59-e5b5-4276-8531-9a896b35f7cb None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:17.410558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-22bfcd59-e5b5-4276-8531-9a896b35f7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:17.499826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.534527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 14/26] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:17.554839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 13/27] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:17.582545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982051cd-6244-4007-b5ed-15954fb515e3 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.583188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982051cd-6244-4007-b5ed-15954fb515e3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.583665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982051cd-6244-4007-b5ed-15954fb515e3 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.585220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 15/28] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:17.590640 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.590927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.591201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.614891 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:17.616145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:17.704492 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 14/29] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:17.899437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982051cd-6244-4007-b5ed-15954fb515e3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.012803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.053483 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982051cd-6244-4007-b5ed-15954fb515e3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.074790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.128433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.129341 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.129682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.129965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.153719 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.156601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:18.198077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:18.199720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:18.200580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:18.200580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:18.200580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:18.206609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 16/30] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:18.208031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.292808 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bf4e-36fd-467e-a433-385daa5cc635 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.303780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.340179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a809c0-3b61-423c-80d4-aff692ac4be3 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.343602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.344852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.345437 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.346075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.347370 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.349269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.373106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.383717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.384556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.384839 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.385117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.399101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:18.404378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:18.405307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 17/31] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:18.411029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.578789 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0261ae-9643-4149-b149-04300a71b41f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.601064 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 15/32] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/roles => generated 219 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:18.602474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.629055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.629966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.630251 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.630595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.632011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.633040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.735249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1886627-0a5d-49dc-9a1f-5ae8c4c40cd6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.785022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.785678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.786021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.786308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.786988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:18.787297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.788908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.820543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 16/33] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:18.821620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.868687 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.898224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 18/34] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/roles => generated 225 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:18.903675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.958753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f05a8-5f8d-4242-81db-fcfe80bd3160 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.005412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.006469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.007962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.008526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.009716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:19.010549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.014813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.018397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.043248 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 17/35] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.049490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.142275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19e53f-6f22-4d30-9424-dc66f65d35f6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.193202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.193944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.194203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.194474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.197182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.203268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428921e-d8aa-455e-a11b-6dc7bda1e74c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.212305 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.228088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f8c9b-8b8d-4d59-ade8-e423613eeb0b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.266885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.267561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.267839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.268114 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.269839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.271297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1224b1-fa17-469b-a419-45700538fd71 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.273234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 18/36] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.274519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c216692-9ad1-4229-b9b7-17bdc94a7cc2 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.274800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c216692-9ad1-4229-b9b7-17bdc94a7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.275075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c216692-9ad1-4229-b9b7-17bdc94a7cc2 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.276452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 19/37] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:19.278056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953950-1059-49f1-8485-2920ab8314a6 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.278340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953950-1059-49f1-8485-2920ab8314a6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.278612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6953950-1059-49f1-8485-2920ab8314a6 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.279908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 20/38] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:19.280669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953950-1059-49f1-8485-2920ab8314a6 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.333289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/projects => generated 301 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:19.334688 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.334995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.335261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.359299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:19.362048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:19.409852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6953950-1059-49f1-8485-2920ab8314a6 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.468071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.469265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.469564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.469881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.471712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.473463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b94248-28a0-42b5-a1a7-8c4923652ad4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.475769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 21/40] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.475769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.475769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.475769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.483305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 20/41] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:19.484438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.518939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:19.522791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:19.543718 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.547066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.628792 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:19.660309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2c98b-571a-43fb-ba8a-2a5cd78c8ce1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.700531 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.701370 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.701823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.702320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] PATH_INFO: `/v3/domains/default/users/4b130916f4b143099f2974e99dac365a/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.704451 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=4b130916f4b143099f2974e99dac365a, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.706210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.819246 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.841369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Aug 18 20:52:19 2022] PUT /identity/v3/domains/default/users/4b130916f4b143099f2974e99dac365a/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:19.941132 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ba454-535b-485f-876a-f71ab22a6004 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.963620 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.986053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.987022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.987457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.987843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.988679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.990385 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.081779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.083884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Aug 18 20:52:19 2022] POST /identity/v3/roles => generated 223 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:52:20.105461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae9ba0a-4d6a-40c5-ac1b-45de45455d5e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.164987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.166016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.166525 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.166985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.168537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.170561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e123-0373-424c-b538-196422ec9334 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.172549 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 22/45] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:20.178627 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.201399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.325948 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6aa82-c68f-47d5-bd79-211e47b68a84 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.369206 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.369940 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.370219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.371913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.371913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.373676 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecfc93-1a34-455d-964a-8bf7dee847cd None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.486510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:52:20 2022] POST /identity/v3/projects => generated 312 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:52:22.101519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a4d23-64b8-4d6b-b860-6725f8bf1231 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.102206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a4d23-64b8-4d6b-b860-6725f8bf1231 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.102206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a4d23-64b8-4d6b-b860-6725f8bf1231 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.103462 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 23/47] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:22.110985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.111650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.112149 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.134820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.136054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.208936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.219700 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:22.553910 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a4d23-64b8-4d6b-b860-6725f8bf1231 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.673898 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a4d23-64b8-4d6b-b860-6725f8bf1231 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.715570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.716192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.716536 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.716873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.733929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-6531fc74-b7de-4bde-bd1c-ba16d71ef932 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:22.738899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:22.739889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:22.740993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 24/49] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:22.746427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.846008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8d08-d87d-4a82-a9d2-846767ecf2c3 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.846298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8d08-d87d-4a82-a9d2-846767ecf2c3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.846626 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8d08-d87d-4a82-a9d2-846767ecf2c3 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.847985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 25/50] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:22.853545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.853859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.854142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.863811 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be3b84-4a87-4f18-bf2f-62838bc0a381 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.874386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.875619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.888734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.902544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.903162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.903434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.903706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.904375 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:22.904677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:22.906073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:22.921021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 26/51] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:22.927119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.958143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:22.998439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.045185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc645db-e1b3-46b4-a1db-35a0a0d80fb7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.086629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.087360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.087823 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.088304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.089519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.091823 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.093592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 27/53] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:23.099689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.209366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97760d-1344-497f-82af-be1cfbd680fa None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.245486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.246153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.246473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.246751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.247909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.249445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.251183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 27/54] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:23.257025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.312231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.328704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.368061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d07f5d0-da83-4241-a79d-5f9198da1fc1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.403499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.414547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.415189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.415493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.415759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.416517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.domain.id=default, user.id=4b130916f4b143099f2974e99dac365a) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:23.416896 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.418976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.433580 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 28/55] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/role_assignments?user.id=4b130916f4b143099f2974e99dac365a&scope.domain.id=default&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 530 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:23.447997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f594a9c-a1f7-413b-92e7-1979255bf5b2 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.493495 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.494200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.494483 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.494760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.496067 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.497675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fded32d-37fd-461c-91c7-0a330329d21b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.499768 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 28/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:23.506667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.638454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170adcd3-c936-4305-93e2-32bd8bacc983 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.702733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.703812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.704275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.704714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.705556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.707434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c90316-1972-470b-b06b-d27325c4ec73 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.790915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 29/57] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Aug 18 20:52:23 2022] POST /identity/v3/projects => generated 298 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:26.042239 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a0ee-b69d-4931-8fd3-b4d9112aa29c None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.042762 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a0ee-b69d-4931-8fd3-b4d9112aa29c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.042849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7178a0ee-b69d-4931-8fd3-b4d9112aa29c None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.044202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 29/58] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:26.050332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.050802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.050887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.069208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:26.070475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:26.107275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:26.146531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 30/59] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:26.488776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a0ee-b69d-4931-8fd3-b4d9112aa29c None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.572817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:26.595409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7178a0ee-b69d-4931-8fd3-b4d9112aa29c None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:26.631072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:26.631698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.631995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.632335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.633546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:26.635006 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1781ab8-70c9-4932-8316-073f8cfbce60 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:26.636560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 30/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:26.642277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.740157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764fd86b-f837-444a-8c4a-a3c6482da2ac None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:26.773420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:26.774054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.774332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.774604 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.775242 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:26.776685 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415a8e5-ae4f-46dd-aedb-e8e305332358 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:26.895788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 31/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:26 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:30.338133 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2ad-6dcf-4f3a-b6fc-8030b5f34550 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.338655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2ad-6dcf-4f3a-b6fc-8030b5f34550 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.338655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdad2ad-6dcf-4f3a-b6fc-8030b5f34550 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.340019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 31/62] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:30.345464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbc3e-694d-49e4-a332-dddbf55353b7 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.346404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbc3e-694d-49e4-a332-dddbf55353b7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.346883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fbc3e-694d-49e4-a332-dddbf55353b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.376300 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-462fbc3e-694d-49e4-a332-dddbf55353b7 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:30.377877 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-462fbc3e-694d-49e4-a332-dddbf55353b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.416684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.448196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef78e9-1ea5-43ef-bb8c-8d09e414b419 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.448834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef78e9-1ea5-43ef-bb8c-8d09e414b419 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.449338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef78e9-1ea5-43ef-bb8c-8d09e414b419 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.451552 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 32/63] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:30.458172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40e1a-9fc6-4248-87fb-bcec668f570d None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.458604 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40e1a-9fc6-4248-87fb-bcec668f570d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.458717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40e1a-9fc6-4248-87fb-bcec668f570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.491428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-12d40e1a-9fc6-4248-87fb-bcec668f570d None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:30.492676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-12d40e1a-9fc6-4248-87fb-bcec668f570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.497286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 32/64] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:30.601105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 33/65] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:30.787639 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7131b-4175-4f62-b72c-24b001c0aff3 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.788380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7131b-4175-4f62-b72c-24b001c0aff3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.788867 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7131b-4175-4f62-b72c-24b001c0aff3 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.790442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 33/66] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:30.796149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.796694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.797186 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.816400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:30.817959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.890032 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 34/67] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:30.903282 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7131b-4175-4f62-b72c-24b001c0aff3 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.007941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.022357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.058185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7131b-4175-4f62-b72c-24b001c0aff3 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.109868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.110773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.111233 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.111651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.120599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e65075-9ef5-494c-b13a-997ae28979b0 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.124219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-2624cbac-df09-4826-963b-15f149422f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:31.130767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:31.131677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:31.132461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 34/68] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:31.133092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2254-2ecb-4341-9c0f-6a452eba78d2 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.133715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2254-2ecb-4341-9c0f-6a452eba78d2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.133715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c2254-2ecb-4341-9c0f-6a452eba78d2 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.134894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 35/69] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:31.139484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655112-95b2-4f24-8f04-0173daa8852e None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.139484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655112-95b2-4f24-8f04-0173daa8852e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.139484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e655112-95b2-4f24-8f04-0173daa8852e None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.139751 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 36/70] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:31.140406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655112-95b2-4f24-8f04-0173daa8852e None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.162489 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.164751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.165867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.166154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.166430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.177515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-ae959a89-dd6c-4a62-b445-4bad15c00943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:31.182360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:31.183365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:31.184155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:31.184819 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995103-d47a-4210-a161-5a6b306760a1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.186097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995103-d47a-4210-a161-5a6b306760a1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.186097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995103-d47a-4210-a161-5a6b306760a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.204226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-12995103-d47a-4210-a161-5a6b306760a1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:31.205453 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-12995103-d47a-4210-a161-5a6b306760a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:31.257120 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e655112-95b2-4f24-8f04-0173daa8852e None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.274560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.280230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 36/72] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:31.289970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.289970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.289970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.304973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.305762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.305954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:31.306187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.306533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.307329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:31.307833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.308130 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:31.309474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.319591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 37/73] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.320584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.399514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 37/74] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:31.401005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.414253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.436610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4bef0-acfd-4938-b806-cf78025ad0a3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.474868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.475628 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.476187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.476591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.477482 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:31.477914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.479537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.489646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.495159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.523227 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53aa5-342a-44d5-92cc-b3bdb3f6303e None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.554859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.562499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.563345 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.563845 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.564270 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.565736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.567340 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.569146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 38/76] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.570212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.614201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06718cb1-a247-4235-a0ad-ef73d8734fa3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.653602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.654195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.654502 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.654752 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.666944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:31.673164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:31.674181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:31.674977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:31.675638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.678983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.694795 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84ea46-9bed-4671-89d4-3bbbd5bc83cf None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.737937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.738743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.739034 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.739824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.754532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.756005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.757698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.758486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.783156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57033ad8-9716-4cb2-a9e9-34b2c8ea7fd3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.819022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.819636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.819918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.820010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.820195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.865413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8457f6a-2ea2-4b85-876c-ab03d88373a7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.890555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.892063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.893995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.902317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.902959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.903242 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.903601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.915028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:31.920402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:31.921264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:31.922077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:31.922728 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.999843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 40/80] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:32.004721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.024431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44672c6-086d-4ec5-8c01-50389f48e9e4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.042637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.060626 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.061238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.061523 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.061827 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.062494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:32.062799 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.065177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.072227 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.073053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.104314 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa7ae-44c0-40ae-836f-29352c00b1af None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.106160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.140004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.140635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.140918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.141193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.142337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.144034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.146046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.150602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.174456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca78a4-0d90-4ef0-b327-f432300ee1d8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.212337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.212951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.213337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.213642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.259677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.262934 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddc984-1cd2-4596-bfc7-798992a654cb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.281460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.282981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.301546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.302196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.302475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.302746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.303412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:32.303714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.305079 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.313953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.314761 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.346695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.388367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:32.389227 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.418828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fab1f-b780-4901-893d-d6dace2a9d8b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.458459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.459036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.459316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.459590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.460759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.462338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.469761 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 43/85] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.469761 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.470016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.491964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e09c3-48ea-4d63-b35b-240821b5109c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.531938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.532576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.532858 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.533135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.534326 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.535794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.537587 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 43/86] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.538285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.566970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.569836 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9cfa57-393a-45f5-a10e-823c827f2cde None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.605464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.606107 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.606387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.606659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.607357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.608835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.638909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a2e910-43bc-4754-86b8-e3194bdd7843 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.672619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.673250 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.673532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.673837 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.675075 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.676524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.678142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 44/87] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.679586 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.693898 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.733173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 44/88] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:32 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:32.734042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.793800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49272cbf-f03a-46c6-9a0b-a584aed4da26 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.838040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.838692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.839093 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.839376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.840720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.842295 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.844463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 45/89] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.845099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.860748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5963028-60ff-42e5-b5ad-08f4543b3da9 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.902675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.903310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.903602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.903901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.904663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=4b130916f4b143099f2974e99dac365a) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:32.904979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.906560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.912515 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 45/90] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/role_assignments?user.id=4b130916f4b143099f2974e99dac365a&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.913978 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.946138 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.960705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.983581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70cc42-94f6-483a-8af3-64d2203dc28d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.032965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.033916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.034337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.034747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.076526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993abf3-5d71-4d8d-81b7-f47c15dfde98 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.117042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.117698 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.117984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.118260 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.126048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.127933 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.201277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.202976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.228915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.242083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.271051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 46/91] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:33.271927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.321170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:33.321917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.442663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87c8ee-a39c-4bdb-9ed2-6d424660dfe0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.503299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ff9cf-bb7a-401c-82f7-8c14031e7776 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.507356 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.507989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.508278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.508558 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.509320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:33.509655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.511134 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.525015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 47/93] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.525779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.529794 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.562476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.563519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.563996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.564465 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.566048 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.567754 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.569708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 47/94] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.578728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.644518 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.717083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c438a-5129-4bff-a491-6ab66f2cc03e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.764762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.765319 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.765620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.765904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.766663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] RBAC: Adding query filter params (role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:33.766978 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.768482 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.783944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 48/95] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=525e28a76eea45b0831b88775497b08f => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.806375 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83719f32-6cf3-4148-ab1c-126f44dd8063 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.866884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.867940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.868416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.868880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] PATH_INFO: `/v3/projects/90c42b439ef2445b8b736e607222720a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.874448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] RBAC: Authorizing `identity:get_project(project_id=90c42b439ef2445b8b736e607222720a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.876202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a44770-0df8-46a9-8211-68f1b29dcd05 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.878174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 48/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/projects/90c42b439ef2445b8b736e607222720a => generated 312 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.884532 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.961836 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.022890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060819f5-8a46-4c6d-9639-d78417b073b2 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.060976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.061625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.061923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.062266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.063104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=90c42b439ef2445b8b736e607222720a, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:34.063471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.065814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3e2b-a4f2-42c4-945f-36f6751e7e4b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.072425 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 49/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=90c42b439ef2445b8b736e607222720a&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:35.917025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781abf5-39ac-4be9-97f7-920ce1f2e420 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.917561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781abf5-39ac-4be9-97f7-920ce1f2e420 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.917561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781abf5-39ac-4be9-97f7-920ce1f2e420 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.918964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 49/98] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:35.924926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8912bb-af95-4d45-85d2-91b686bb95bd None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.925449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8912bb-af95-4d45-85d2-91b686bb95bd None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.925449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8912bb-af95-4d45-85d2-91b686bb95bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.945351 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ae8912bb-af95-4d45-85d2-91b686bb95bd None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:35.946756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ae8912bb-af95-4d45-85d2-91b686bb95bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.020586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 50/99] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:36.420185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781abf5-39ac-4be9-97f7-920ce1f2e420 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.470197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64e9b-4dcb-4bf7-9467-1fdc301bc291 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.470197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64e9b-4dcb-4bf7-9467-1fdc301bc291 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.470197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e64e9b-4dcb-4bf7-9467-1fdc301bc291 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.470197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 51/100] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:36.478457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d82f8-d2b2-49b2-92c6-806295d59d33 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.478888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d82f8-d2b2-49b2-92c6-806295d59d33 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.479291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d82f8-d2b2-49b2-92c6-806295d59d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.511134 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d44d82f8-d2b2-49b2-92c6-806295d59d33 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.512005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d44d82f8-d2b2-49b2-92c6-806295d59d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.594039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.628738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 52/101] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:36.631504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cd10d-424b-409b-8663-1d9145587eaf None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.631504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cd10d-424b-409b-8663-1d9145587eaf None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.631504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005cd10d-424b-409b-8663-1d9145587eaf None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.632054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 53/102] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:36.637642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda475a0-74ee-4ad9-8bd8-305da5483e68 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.637940 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda475a0-74ee-4ad9-8bd8-305da5483e68 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.638225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda475a0-74ee-4ad9-8bd8-305da5483e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.658306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-cda475a0-74ee-4ad9-8bd8-305da5483e68 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.659517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-cda475a0-74ee-4ad9-8bd8-305da5483e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.675081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781abf5-39ac-4be9-97f7-920ce1f2e420 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.706028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.749640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.750437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.750722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.750996 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.768315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 54/103] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:36.769631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43641-4174-48c1-b5d7-eebbef3d6cf3 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.774207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43641-4174-48c1-b5d7-eebbef3d6cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.774966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de43641-4174-48c1-b5d7-eebbef3d6cf3 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.776533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 55/104] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:36.788717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:36.797714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d55bc-78c6-4b4a-a4f1-f05080eb2bd4 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.797714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d55bc-78c6-4b4a-a4f1-f05080eb2bd4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.797714 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d55bc-78c6-4b4a-a4f1-f05080eb2bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:36.799272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:36.800376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:36.801348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 50/105] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:36.807452 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.827272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-032d55bc-78c6-4b4a-a4f1-f05080eb2bd4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.828977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-032d55bc-78c6-4b4a-a4f1-f05080eb2bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.926695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 56/106] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:36.928723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0132b2-d726-44cf-b156-68eeb700ebf4 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.929166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0132b2-d726-44cf-b156-68eeb700ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.930497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0132b2-d726-44cf-b156-68eeb700ebf4 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.932818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 57/107] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:36.939988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.940498 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.940928 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.971623 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.974211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:37.022057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.077896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1ff-d191-426f-97a8-5b34f9006bc6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.078574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 58/108] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:37.137557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.138220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.138508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.138820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.139524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:37.139834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.141257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.162867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 51/109] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:37.168568 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.183960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.237064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.349782 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae281494-04c5-47a0-bb47-41534b7b237b None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.364301 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74531d-3eed-48ce-b4be-24f43527080c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.424022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.425024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.425929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.426796 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.427285 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.428023 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.428289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.428779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.430792 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.431618 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.434345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.435191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.439420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 59/111] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:37.439707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 52/111] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:37.440828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.444503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.506321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.581970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6fca65-4651-4606-a4dc-cffe2f0bc8d5 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.586834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a02a30-d1aa-4ea8-ab62-338d8babe47d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.590450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.623278 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.623942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.624232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.624486 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.624833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.625472 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.625782 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.626058 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.627198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.628720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.630436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 53/112] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:37.631053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.642802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:37.647732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:37.648705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 60/113] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:37.655173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.760168 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf98f78f-ac17-4057-b4ea-bdb639cbedea None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.788736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.797523 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e2f28-31c8-4300-97de-4c50846725db None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.802038 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.802651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.802941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.803297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.803954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.805409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.834890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.835549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.835828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.836101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.846821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:37.851684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:37.852625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:37.853389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 61/114] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:37.854824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.875685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 54/115] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:52:37 2022] POST /identity/v3/projects => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:37.878119 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.915637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.979594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09abdbe-ff74-4002-81ed-34a3bb0ad976 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.011701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db6501-db3d-40ba-8c6e-fcce72af4e5d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.022776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.023421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.023703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.023982 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.037187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:38.042151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:38.043104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:38.043901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 62/116] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:38.044556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.065663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.065852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.066582 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.066927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.067177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/4b130916f4b143099f2974e99dac365a/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.070824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user_id=4b130916f4b143099f2974e99dac365a, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.072308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.173640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 55/117] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:37 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/4b130916f4b143099f2974e99dac365a/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:38.173640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.236703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b690e34-c3a5-4666-bcbd-03ae96c04d89 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.288692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.305946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.306585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.306865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.307223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.307721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0957be-eade-4189-935e-487a605e3a60 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.307921 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:38.308230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.309801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd687ff4-fd81-49ee-9bd0-93b0ad8b0def None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.325474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 63/118] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.336108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96e56-517e-494d-b554-1edd3d7b0984 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.336108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96e56-517e-494d-b554-1edd3d7b0984 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.336108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b96e56-517e-494d-b554-1edd3d7b0984 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.336108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 64/119] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:38.336108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b96e56-517e-494d-b554-1edd3d7b0984 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.350801 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.351432 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.351710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.351982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.352671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:38.352972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.354447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13749836-1349-43ce-af2d-17532c8c0ec8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.364491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 56/120] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.366162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.366162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.366496 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.390257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.391530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.443484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.477915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b96e56-517e-494d-b554-1edd3d7b0984 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.494842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 57/121] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:38.496457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.522378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.522998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.523278 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.523551 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.524230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:38.525493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.526909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.538493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 65/122] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.539207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.615800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.646925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1bafa-c63e-49bb-a19c-396de9b6ddc3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.657794 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb2be79-485c-4879-a3de-8ca99af8e938 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.709411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.710136 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.710420 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.711270 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] PATH_INFO: `/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.721663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.722303 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.722655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.722936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.724361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.728102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.731213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 66/123] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.732051 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.739461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] RBAC: Authorizing `identity:get_user(user_id=5cc4a8382a1b4aed91a267dbc295c0c8)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.741730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.747887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.748790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 58/124] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8 => generated 289 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.749716 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.923757 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a7b26-d444-4f1a-b541-7254575a3e4f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.947777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6aee1-3a5b-47e4-ba4c-e5ec2128bd77 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.959686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.960332 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.960615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.960893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.962161 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.963748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.965530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 59/125] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:38.966560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.976615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.004739 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.006118 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.006729 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.007235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.008639 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.010387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.012284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 67/126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.013464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.082794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d97abe-78b4-4bd8-894f-b1e6e551eb24 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.120663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.135299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.136236 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.136665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.137336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.146848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb60b-987e-4a20-99be-63929e81402e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.185704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.186222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.186605 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.186982 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/653279e1559647a291c539cd21cc62ef/roles/525e28a76eea45b0831b88775497b08f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.189341 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user_id=653279e1559647a291c539cd21cc62ef, role_id=525e28a76eea45b0831b88775497b08f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.191003 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.224427 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.226072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.228142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.280211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 68/127] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:39 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/653279e1559647a291c539cd21cc62ef/roles/525e28a76eea45b0831b88775497b08f => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:39.280211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.419424 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 60/128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:39.420874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.486352 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0cc4-a8d5-445c-a94f-7857fb784992 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.553860 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.554510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.554910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.555186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.557213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.566896 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:39.572016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:39.572888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:39.575755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:39.578031 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 69/129] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:39.578938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.617508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f7d7dd-5dd5-4224-a9b4-d602245bfb39 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.620569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.668932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.669168 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.669471 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.669855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.671648 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.673192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.675137 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 61/130] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.677563 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.705041 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf8919-b444-4470-8f85-e1bfbf349746 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.744986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.746049 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.746677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.747175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.748740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.750638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.752788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 70/131] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.753876 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.873457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.887624 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16360b-a79c-41c5-ab90-92aa385fd9c7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.949448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a4d44-cd45-463c-9d01-b52907047146 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.964602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.965585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.966095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.966568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.968047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:39.969840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.974253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.993779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 62/132] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.995190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.032348 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.042427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.042427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.042427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/653279e1559647a291c539cd21cc62ef/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.042427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user_id=653279e1559647a291c539cd21cc62ef, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.042427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.063203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.122470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 71/133] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:39 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/653279e1559647a291c539cd21cc62ef/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:40.123414 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.164697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af408822-5dcc-4f0b-8e07-cc6a2c9caa47 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.239640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.240397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.240904 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.241188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.242000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=5cc4a8382a1b4aed91a267dbc295c0c8) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:40.242323 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.244444 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.257222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 63/134] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/role_assignments?user.id=5cc4a8382a1b4aed91a267dbc295c0c8&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=32e2b5a3107f491691d78f63832eae41 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.341593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9bf79-9643-4b85-bbe0-43ffe885add3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.391958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.411054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.411708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.411995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.412275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.413445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.414962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.416902 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 72/135] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.424670 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.554515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.561470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826b55c-d9ab-405e-a3c4-518677aa69ab None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.604178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.605183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.605684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.606153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] PATH_INFO: `/v3/projects/90c42b439ef2445b8b736e607222720a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.607766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] RBAC: Authorizing `identity:get_project(project_id=90c42b439ef2445b8b736e607222720a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.611183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e419aa88-ea8e-4156-9a80-6a5f64d6e654 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.612920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 64/136] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/projects/90c42b439ef2445b8b736e607222720a => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.621650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.688621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203855f-9bfb-4f2f-af89-e855bd8d4e9c None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.688973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203855f-9bfb-4f2f-af89-e855bd8d4e9c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.689199 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203855f-9bfb-4f2f-af89-e855bd8d4e9c None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.690867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 65/137] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:40.696731 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc110b-dfb5-40fc-a45e-1ce84ac8668b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.697394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc110b-dfb5-40fc-a45e-1ce84ac8668b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.697917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc110b-dfb5-40fc-a45e-1ce84ac8668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.734551 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-41dc110b-dfb5-40fc-a45e-1ce84ac8668b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:40.738951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-41dc110b-dfb5-40fc-a45e-1ce84ac8668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:40.801181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb79bee-165c-40e2-9f71-30ef665b42ed None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.867156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.867859 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.868144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.868429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] PATH_INFO: `/v3/projects/90c42b439ef2445b8b736e607222720a/users/653279e1559647a291c539cd21cc62ef/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.872322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=90c42b439ef2445b8b736e607222720a, user_id=653279e1559647a291c539cd21cc62ef, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.874454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.876193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 66/138] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:40.877712 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfa2-d528-47e7-b641-8866e6e00791 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.878004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfa2-d528-47e7-b641-8866e6e00791 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.878282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfa2-d528-47e7-b641-8866e6e00791 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.879960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 67/139] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:40.886944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.887232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.887513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.907092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:40.908306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:40.978980 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 68/140] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:41.020364 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 73/141] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:40 2022] PUT /identity/v3/projects/90c42b439ef2445b8b736e607222720a/users/653279e1559647a291c539cd21cc62ef/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:41.424811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.446924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.469108 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.555024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.585738 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054e9d7-8ba5-401a-b1fd-4e648aa0d37e None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.665840 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8aba-2a64-403c-ba5c-b74637832f9b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.683307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.683887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.684172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.684450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.690713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.693367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.699558 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 69/142] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.706148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.725651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.726303 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.726586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.726860 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.749042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:41.755312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:41.756247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:41.757030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:41.759422 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 74/143] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:41.770791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.922756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.938769 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671e3095-d76f-4a2a-8b83-e422ca7f48c0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.953177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aad136-55e2-40a8-b177-4734165f5ed3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.973532 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:42.006791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.007402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.007674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.007967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.008595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.010099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.022915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.023543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.023822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.024098 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.024846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:42.025154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.027012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.043017 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 75/144] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:42.052095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:42.145782 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 70/145] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:41 2022] POST /identity/v3/users => generated 283 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:42.205267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f4bafe-942f-4f3b-bbb8-cef1339becc6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.257143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.258252 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.258788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.259304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] PATH_INFO: `/v3/users/4b130916f4b143099f2974e99dac365a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.260965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] RBAC: Authorizing `identity:get_user(user_id=4b130916f4b143099f2974e99dac365a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.262880 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b79b18-daf2-4d07-8bdb-86b2662b86e4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.265029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 76/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/users/4b130916f4b143099f2974e99dac365a => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:42.271435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:42.415846 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c605105-e84a-40b0-87ed-75261c7ffb0c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.476651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.478150 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.478685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.479176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.510090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:42.538119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6300-4fa2-4656-8590-b3224fd7f650 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.539104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6300-4fa2-4656-8590-b3224fd7f650 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.539600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb6300-4fa2-4656-8590-b3224fd7f650 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.541151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 77/147] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:42.550530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.551116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.551593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.580846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:42.583110 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:42.608787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.610792 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.659173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:42.735298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 78/148] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:42.781204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 71/149] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:42.787055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:42.917516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de30a0-80cc-4d08-bee2-990165bfefb4 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.962283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.963301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.963809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.964282 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.965718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.967458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.969367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 79/150] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:42.975534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:43.050908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:43.122968 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978ebac-bfdd-470c-b4bb-15efe13e1715 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:43.160754 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:43.161517 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.161862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.162189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.163016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=4b130916f4b143099f2974e99dac365a) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:43.163387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:43.164982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:43.173755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 72/151] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/role_assignments?user.id=4b130916f4b143099f2974e99dac365a&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:43.191209 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:43.244688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:43.323191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ed595-5b41-423b-94d3-a6bb4b0aff5a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:43.364376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:43.365023 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.365301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.365579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.382844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:43.387807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:43.388695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:43.389517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 80/152] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:43.397218 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:43.540044 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5041d1ae-0748-4512-bdc4-1e32473ebdbd None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:43.557816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:43.581897 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:43.582443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.582726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.583064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.584139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:43.584457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:43.585944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd655fe-f873-4c84-9fde-748f8252fa43 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:43.604122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 73/153] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:43.611271 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:43.739820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:43.745000 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2d77e-01ea-4f6c-b219-7752fc774269 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:43.783406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a97c2-740e-4788-96a3-62665f07c08d None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.784076 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a97c2-740e-4788-96a3-62665f07c08d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.784605 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125a97c2-740e-4788-96a3-62665f07c08d None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.786514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 74/154] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:43.793207 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3700e-fd3b-44b5-993b-866e0f4e717f None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.793863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3700e-fd3b-44b5-993b-866e0f4e717f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.794394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd3700e-fd3b-44b5-993b-866e0f4e717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.803878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:43.804529 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.804800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.805078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.806970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:43.808440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:43.810469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 81/155] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:43 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:43.817660 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:43.838885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-3cd3700e-fd3b-44b5-993b-866e0f4e717f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:43.840429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-3cd3700e-fd3b-44b5-993b-866e0f4e717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:43.955128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056b5d4-c501-46f7-b7ba-44473a2d4861 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:43.955985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:43.957673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735892f-0a31-4800-a020-a2c03091e767 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.957784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735892f-0a31-4800-a020-a2c03091e767 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.958123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735892f-0a31-4800-a020-a2c03091e767 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:43.960109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 76/157] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:43.975532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:43.976283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:43.976769 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.005565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.006213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.008797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.009158 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.020386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:44.023371 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:44.084298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:44.133341 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:44.134890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:44.158974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:44.263573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 82/159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:44.269406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.308546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:44.393802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e7da9-a8b2-4979-a9d4-6ac26b1a7c0d None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:44.437710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.438363 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.438650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.438920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.440082 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:44.441547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:44.443555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 78/160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:44.449294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.469642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.577767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:44.658327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2fb5f-f811-436b-b9ac-274162f1c05f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:44.662851 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:44.694731 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3998e3-a9b6-41ab-9945-8ebee02c5bb3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:44.777433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.778478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.778762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.779200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.780740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] RBAC: Adding query filter params (role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:44.781064 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:44.782615 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:44.794657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 83/161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=525e28a76eea45b0831b88775497b08f => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:44.794828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:44.795892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.796482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.796974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.815638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:44.831420 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:44.842180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:44.843706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:44.844544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:44.845780 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 79/162] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:44.855208 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.053673 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab63ea-2eb3-4f25-8424-e4d773fee1f1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.080060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998c084-dfcc-4188-9ce3-2a2b375a270d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.111047 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.122286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.122956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.123239 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.123515 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.157564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:45.159777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.160256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.160566 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.160854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.161540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:45.161867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.163446 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed385e-3873-4c51-a0fe-178f759e24b7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-5574dfa1-c239-44c4-ac18-cb7ae0886410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:45.165835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:45.166712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 84/163] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:45.172905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a753e4-fb75-4581-84ed-ab0ffd858dfe None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.173666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a753e4-fb75-4581-84ed-ab0ffd858dfe None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.173666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a753e4-fb75-4581-84ed-ab0ffd858dfe None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.175086 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 85/164] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:45.176638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a753e4-fb75-4581-84ed-ab0ffd858dfe None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.182688 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 80/165] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:45.187423 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.187980 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.188431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.208279 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:45.209930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:45.247087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.361570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:45.362282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.399883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a753e4-fb75-4581-84ed-ab0ffd858dfe None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.490964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.491587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.491861 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.492123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.492917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:45.493229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.494622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.510465 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 86/167] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:45.517837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.574740 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3efe65-f9b7-4eb8-984f-f3e40bc9ccc3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.600635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.644202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.644202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.644202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.644202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] PATH_INFO: `/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.644585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc4a8382a1b4aed91a267dbc295c0c8)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.644585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.644585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 82/168] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8 => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:45.646474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.686925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.690670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e04f196-2079-46ee-af34-a1ee8ff7a1d8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.755456 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.756129 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.756394 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.756621 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.758433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.759902 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.761503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 87/169] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:45.768648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.837430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a872fa-1976-432e-928e-9fd1beedece7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.909767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.910323 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.910602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.910874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.913257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.915827 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.919077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 83/170] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:45.919864 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.939371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703e7d7-97bb-4627-b204-f4aebe20a694 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.976358 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.006820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.007543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.007820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.008088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.106538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.125700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d491d3f-516f-4d68-a2d1-92477cf743f9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.144588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.146124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.219105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.220090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.220570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.221086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.253592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:46.254620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.255418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:46.265179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:46.266198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:46.267089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:46.269503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 84/172] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:46.270921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.290005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.372421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aac59a-8a01-4963-b3f6-832e59335e8c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.429596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.430428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.430784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.431083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/5cc4a8382a1b4aed91a267dbc295c0c8/roles/32e2b5a3107f491691d78f63832eae41` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.433297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user_id=5cc4a8382a1b4aed91a267dbc295c0c8, role_id=32e2b5a3107f491691d78f63832eae41)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.435096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.494327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a5fd6b-9993-44c3-9294-f175e64f6d5f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.533120 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.533815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.534093 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.534370 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.535605 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.537183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.541356 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 85/173] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:46.547339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 89/174] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:46 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/users/5cc4a8382a1b4aed91a267dbc295c0c8/roles/32e2b5a3107f491691d78f63832eae41 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:46.551855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.551996 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.597021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.728267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.768249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc98039-9a66-4a78-ac15-ea6158742284 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.800150 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf403e9-58db-4db7-9c7b-12894fe31161 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.826069 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.826691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.826974 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.827775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.828525 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:46.828837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.830371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d794e23-de27-4771-ae8c-ada22d80c308 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.838686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 90/175] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:46.839827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f76b32-faef-4f59-9bd2-5add3876e989 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.840116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f76b32-faef-4f59-9bd2-5add3876e989 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.840391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f76b32-faef-4f59-9bd2-5add3876e989 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.844125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 91/176] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:46.852971 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd82a-4e5d-4d53-b456-6ed0af17ae7c None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.853318 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd82a-4e5d-4d53-b456-6ed0af17ae7c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.853528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabd82a-4e5d-4d53-b456-6ed0af17ae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.884141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.885148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.885642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.887741 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.888710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:46.892755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.894489 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.898007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-4eabd82a-4e5d-4d53-b456-6ed0af17ae7c None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.904957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-4eabd82a-4e5d-4d53-b456-6ed0af17ae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.922697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 86/177] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:46.928643 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.024527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 92/178] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:47.026568 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126f6-4c02-4cac-a919-ff0d5c1fcc22 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.033642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126f6-4c02-4cac-a919-ff0d5c1fcc22 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.034623 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c126f6-4c02-4cac-a919-ff0d5c1fcc22 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.036802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 93/179] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:47 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:47.042610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7ac-5ba6-4ac5-b214-4a95604f1534 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.043230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7ac-5ba6-4ac5-b214-4a95604f1534 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.043711 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c1a7ac-5ba6-4ac5-b214-4a95604f1534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.062306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.079172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-98c1a7ac-5ba6-4ac5-b214-4a95604f1534 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:47.080983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-98c1a7ac-5ba6-4ac5-b214-4a95604f1534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:47.085477 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada9755d-f434-4dee-9ff4-24b6e1d3dd82 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.126146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.126823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.127177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.127462 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] PATH_INFO: `/v3/users/653279e1559647a291c539cd21cc62ef` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.128874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] RBAC: Authorizing `identity:get_user(user_id=653279e1559647a291c539cd21cc62ef)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.130596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.132779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 87/180] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/users/653279e1559647a291c539cd21cc62ef => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:47.145644 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.266060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ceefe-4059-4521-b780-663eeba4a7b6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.306881 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.307417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.307695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.307967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.315181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 94/181] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:47.330055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.389362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.390941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.431205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c75b-e7ba-44ab-aaaa-7123d1036f7e None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.431509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c75b-e7ba-44ab-aaaa-7123d1036f7e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.431759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0c75b-e7ba-44ab-aaaa-7123d1036f7e None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.433289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 95/182] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:47.442301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.442613 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.442857 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.470958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.490759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:47.491987 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:47.522968 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 88/183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:47.528980 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.590103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.614581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 96/184] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:47.615534 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.654123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fdfbbc-b717-463b-91e2-8696058b82c6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.694534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.695182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.696031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.696309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] PATH_INFO: `/v3/projects/90c42b439ef2445b8b736e607222720a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.697669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] RBAC: Authorizing `identity:get_project(project_id=90c42b439ef2445b8b736e607222720a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.699583 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.702350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 89/185] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/projects/90c42b439ef2445b8b736e607222720a => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:47.703336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.769028 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9152f-cc92-4042-8c19-fa6154a698a5 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.806029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.806669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.806946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.807216 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.809147 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.819392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:47.824791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:47.825973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:47.826975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:47.828943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 97/186] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:47.834510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f541b-9571-44a3-bba6-afe78d160dcb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.835326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.853090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.871871 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.872569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.872841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.873121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.874915 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.876841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.879196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 90/187] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:47.880079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.946843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d235c-9fca-4bc6-9b84-cc74e8074286 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.983700 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.984586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.985010 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.985425 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.986466 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=90c42b439ef2445b8b736e607222720a, user.id=653279e1559647a291c539cd21cc62ef) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:47.986936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.988601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.990077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c949dea-cbc5-4dd1-b805-1edac0310e3c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.996119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 98/188] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/role_assignments?user.id=653279e1559647a291c539cd21cc62ef&scope.project.id=90c42b439ef2445b8b736e607222720a&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:47.997374 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.031225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.031858 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.032141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.032421 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.033110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:48.033417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.034924 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.044725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 91/189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:48.044725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.080127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.106922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.129315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a846e35-5cb7-4cfb-ad25-5b094c9dfec7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.168919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767204c-75b3-41e3-b5b5-419dcbd6a038 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.169837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.170619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.171706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.172117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.172923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.174567 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.210645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.211283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.211563 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.211840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.222604 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:48.227883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:48.228919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 92/190] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:48.230015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.279987 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 99/191] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:47 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:48.281373 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.361518 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3be050-1205-483a-bcc5-1a0e5616261d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.373897 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.409802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.410890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.411433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.411941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.431974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.433873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.435122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e458a6-9f47-4724-8b7b-e76b287883b7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.436051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 93/192] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:48.443417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.469071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.495236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.496243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.496718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.497206 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.498135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:48.498675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.501129 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.512085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 100/193] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:48.518512 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.599301 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604ac2a-1eff-45aa-9880-b508b9378067 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.641752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.642289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.642555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.642863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.653578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25369aa2-455e-49b0-a578-7de708d10d51 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.689971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.717597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.718806 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.719088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.720084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.723795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.725284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.727448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 101/194] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:48.734560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.750533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.752192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.795708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.862446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63779fd-f559-41b4-9864-d851c5d2de27 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.921996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.925923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.926620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.927057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.942795 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 94/195] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:48.950075 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.078411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.090428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.091925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.162301 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab139c5-0809-47d5-bd48-ec5cc011f844 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.175296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.204386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.205030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.205308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.205581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.206847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.208368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.210336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 95/196] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:49.215957 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.296986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 102/197] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:49.302681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.329297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5b04f-9b5b-4f54-93e2-b33b5658cf9e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.381187 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.387777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.388873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.389360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.390121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.391134 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=2dfc6238fc8546bca58e207f8cecf55a) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:49.392349 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.394512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f347-d7d7-4de2-8133-5015360b0e74 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.410636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 96/198] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/role_assignments?user.id=2dfc6238fc8546bca58e207f8cecf55a&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:49.410636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf42a-5b81-4058-b58d-537f2caedf65 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.410636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf42a-5b81-4058-b58d-537f2caedf65 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.410636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bf42a-5b81-4058-b58d-537f2caedf65 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.418979 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 97/199] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:49.423009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.423296 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.423565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.462245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:49.462431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:49.500865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b336f0c1-60eb-4b8c-890a-e01cd5b79533 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.566757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.567421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.567700 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.567973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.569178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.572096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.572500 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 103/200] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:49.579052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.600057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.650413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:49.703962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24da451-12fe-4848-98c0-7940767ce90e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.757845 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.758380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.758658 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.758931 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.759673 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] RBAC: Adding query filter params (role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=2dfc6238fc8546bca58e207f8cecf55a) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:49.759984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.761454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.770369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 104/202] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/role_assignments?user.id=2dfc6238fc8546bca58e207f8cecf55a&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=525e28a76eea45b0831b88775497b08f => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.192667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.328932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35139cd3-3414-402e-ba6a-e2c7090085e5 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.355913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.368907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.369617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.369901 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.370157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.389780 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:50.395210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.396099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:50.396905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 99/203] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.404165 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.512545 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.537067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc225a-2ab1-4214-a4ff-ad611875d77f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.572164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.572778 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.573057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.573328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.574043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:50.574444 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.575849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.585455 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 105/204] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.591256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.700347 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e3cf6-1703-437b-a712-a2129c88570f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.742643 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.743230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.743509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.743784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] PATH_INFO: `/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.745198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] RBAC: Authorizing `identity:get_user(user_id=5cc4a8382a1b4aed91a267dbc295c0c8)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.746954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.748689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 100/205] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/users/5cc4a8382a1b4aed91a267dbc295c0c8 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.754593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.861457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d9901-5758-439a-a958-fbd4605fdd6f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.899343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.899956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.900234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.900507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.913968 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.972181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.973862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.079705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 106/206] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:51.085201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.144624 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.193069 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272328d-f90b-4bb6-9b83-87623cff5f63 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.235457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.236103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.236481 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.236757 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.237971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.239498 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59b0b9-fa07-4766-a560-b6fe3b079844 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.241474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 101/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.251338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.293689 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.395796 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d4f25-bcd2-4935-8e7a-89112157dd44 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.445193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.446758 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.447240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.447733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.448678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0, user.id=5cc4a8382a1b4aed91a267dbc295c0c8) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.449191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.450884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda2a25-42aa-4619-97b0-9ec8dd92ee0f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.463390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 107/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/role_assignments?user.id=5cc4a8382a1b4aed91a267dbc295c0c8&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=32e2b5a3107f491691d78f63832eae41 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.481787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb91-2373-4890-a918-2c6fd5b12421 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.482068 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb91-2373-4890-a918-2c6fd5b12421 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.482347 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00eb91-2373-4890-a918-2c6fd5b12421 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.484681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 102/209] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:51.490175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.490466 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.490746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.519704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:51.521230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:51.583344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce25c3-52a4-4fdc-a077-63c39bcd8b51 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.583625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce25c3-52a4-4fdc-a077-63c39bcd8b51 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.583924 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce25c3-52a4-4fdc-a077-63c39bcd8b51 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.585774 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 103/210] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:51.598306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b924b-1239-4b63-873e-573acab33c2a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.599022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b924b-1239-4b63-873e-573acab33c2a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.601122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b924b-1239-4b63-873e-573acab33c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.635751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-be9b924b-1239-4b63-873e-573acab33c2a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:51.638341 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-be9b924b-1239-4b63-873e-573acab33c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:51.646433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 108/211] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:51.738001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 104/212] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:52.000205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.053212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.118324 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6433-e37b-458b-8d4b-684f0f2e3f1b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.118957 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6433-e37b-458b-8d4b-684f0f2e3f1b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.120157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6433-e37b-458b-8d4b-684f0f2e3f1b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.122276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 105/213] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:52.128911 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.129182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.129454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.148211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:52.149386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:52.153188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda98621-f7f6-4c0d-91b9-0ea121ef6f25 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.189279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.189940 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.190213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.190476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.201077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.204218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:52.209024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:52.215494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 109/214] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:52.216509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.238041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 106/215] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:52.239004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.342884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.353320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fa220-87b9-4ac2-8ba0-c98fad00e19e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.358855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9686f7e-9f4a-4a31-9933-3a99236fa88f None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.402859 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.403639 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.403969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.404315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.405516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.405781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.406550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.406975 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.407389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.407515 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.408331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.408786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.411487 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 110/216] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.414803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.417306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.427649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 107/217] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.433777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.504201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.567211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef403e44-b1f0-40df-b705-58ad270e6ca7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.568043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7114e-cbf2-4a26-ad45-3787cf5a3d54 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.603499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.603724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.604030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.604301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.604421 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.604570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.604690 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.604900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] PATH_INFO: `/v3/users/178bb227db314cbb90e956931dc16e07` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.605226 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.606701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.618922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] RBAC: Authorizing `identity:get_user(user_id=178bb227db314cbb90e956931dc16e07)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.620400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a2bc7-a710-486a-b880-086438b5bf18 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.622139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 108/218] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/users/178bb227db314cbb90e956931dc16e07 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.623315 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071025-36c3-4968-a3ab-8f937c65dbad None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.623593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071025-36c3-4968-a3ab-8f937c65dbad None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.623956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36071025-36c3-4968-a3ab-8f937c65dbad None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.625714 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 109/219] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:52.629959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071025-36c3-4968-a3ab-8f937c65dbad None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.729029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 111/220] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:52 2022] POST /identity/v3/users => generated 297 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:52:52.735964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36071025-36c3-4968-a3ab-8f937c65dbad None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.737788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.740084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.767904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.778925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.779608 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.780409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.780409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.792958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-cdf84ef6-6b99-4817-a4c9-154593bf8534 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:52.798930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:52.800111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:52.801000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:52.805307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 110/221] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:52.806800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.807103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.807415 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.828047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:52.829436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:52.876925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e30fe0-4134-45fb-b901-9c6759fd9835 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.917042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 111/222] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:52.918133 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.927537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.928477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.928895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.929308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.034433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.035919 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.060962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.061483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.078202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78841-f2bb-427f-97bd-74f6ed01e2b7 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.122279 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.122910 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.123185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.123457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.124140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.124448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.126743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.139972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 112/223] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.147930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.185110 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 112/224] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:53.196145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.281921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce919ff-753a-48f6-b035-08e331817b5e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.322567 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e736d-9667-4bf7-92f9-bb6bbc5577ef None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.334148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.334953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.335747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.336128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.337846 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.340182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.342318 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 113/225] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:53.343401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.346234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.369679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.370937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.371403 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.371856 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.373371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.375663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.377698 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 113/226] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.379116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.384708 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.472268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b1fd70-0cf3-4017-b815-3b047f55fb98 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.511960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.512995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.513573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.514096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.517961 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6965f93-c563-4454-8ea0-ca0ff35d746e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.526537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:53.532655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:53.533569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:53.534429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:53.536927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 114/227] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:53.539134 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.565524 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.566215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.566499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.566775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.568519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.572485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.576157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 114/228] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.577154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.639814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.648753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.659920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c625d-053e-4ff4-a4c1-df843a18c742 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.698083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a4cf0-dee6-4fa8-b9fe-1c4ba3add034 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.698595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.699335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.699716 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.700090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.700948 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=178bb227db314cbb90e956931dc16e07) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.701360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.702998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.709824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 115/229] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/role_assignments?user.id=178bb227db314cbb90e956931dc16e07&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.710958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.758341 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.759256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.759693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.760122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.761011 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.761518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.763263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.783980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 115/230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.798948 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.849797 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac070df-2802-4820-a54f-fbd428c55ab4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.895309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.895998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.896273 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.896544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/2dfc6238fc8546bca58e207f8cecf55a/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.898555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, user_id=2dfc6238fc8546bca58e207f8cecf55a, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.900020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.957397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac67c78-9b22-476a-8d2c-87255c4ceb49 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.974754 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.998747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.999404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.999741 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.000017 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.001636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.003144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.005148 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 116/231] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:54.011001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:54.061072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 116/232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:53 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/2dfc6238fc8546bca58e207f8cecf55a/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:54.146190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb68202-1b5b-4271-9e65-ab406f76e401 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.194193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.195241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.195862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.196362 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.198357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.200144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cd468a-68f8-4dc1-9766-5f13c5d92d62 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.202323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 117/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:54 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:54.209268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:54.220093 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:54.332285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127f54-c670-4fab-aa01-79529fa05176 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.376680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.377745 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.378259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.378740 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/2dfc6238fc8546bca58e207f8cecf55a/roles/525e28a76eea45b0831b88775497b08f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.381528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, user_id=2dfc6238fc8546bca58e207f8cecf55a, role_id=525e28a76eea45b0831b88775497b08f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.383283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dba31cb-946e-4913-abc7-28ce4eff7ebf None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.530708 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:54 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/2dfc6238fc8546bca58e207f8cecf55a/roles/525e28a76eea45b0831b88775497b08f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:55.532997 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d72-ec1f-4e04-8f40-ddcdaa7861be None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.533506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d72-ec1f-4e04-8f40-ddcdaa7861be None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.533581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c8d72-ec1f-4e04-8f40-ddcdaa7861be None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.535095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 118/235] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:55.540995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a50c-3261-4c72-ae76-e1ebc94d8be0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.541445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a50c-3261-4c72-ae76-e1ebc94d8be0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.541543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a50c-3261-4c72-ae76-e1ebc94d8be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.565992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-faf3a50c-3261-4c72-ae76-e1ebc94d8be0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:55.567593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-faf3a50c-3261-4c72-ae76-e1ebc94d8be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:55.653093 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:55.661650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 118/236] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:55.693829 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f783-3c06-45a2-baa8-6ed511ddb883 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.694115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f783-3c06-45a2-baa8-6ed511ddb883 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.694395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15f783-3c06-45a2-baa8-6ed511ddb883 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.696114 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 119/237] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:55.701907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.702193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.702539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.721484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:55.722732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:55.832672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 119/238] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:56.153229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15f783-3c06-45a2-baa8-6ed511ddb883 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.226375 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.302351 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15f783-3c06-45a2-baa8-6ed511ddb883 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.350279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.350920 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.351196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.351468 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.367710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:56.372949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.374329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:56.375745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 120/239] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:56.380140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.395779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.495503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2458a-4b01-4bd6-835b-46f430915ef4 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.529160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.538817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.539742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.540183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.544873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.544873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] RBAC: Adding query filter params (name=reader) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.544873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.544873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8ba67-7024-438a-babc-da527044ee9d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.553288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 120/240] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.557769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091580e-05be-47a7-8bd1-51ee5c6d0d12 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.559715 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa1e7-6d90-4b93-b6b0-1c8201761c92 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.560223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa1e7-6d90-4b93-b6b0-1c8201761c92 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.560692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fa1e7-6d90-4b93-b6b0-1c8201761c92 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.563470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 121/241] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:56.564438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fa1e7-6d90-4b93-b6b0-1c8201761c92 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.575533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.597501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.598160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.598441 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.598781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.599919 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.601385 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c5454-748a-4cda-bf58-603331f04899 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.603225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 121/242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:56.609154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.609445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.609984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.632256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:56.634181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:56.691096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fa1e7-6d90-4b93-b6b0-1c8201761c92 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.733658 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 122/243] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:56.738660 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.754441 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.755105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.755381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.755657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] PATH_INFO: `/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.802352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ce89a8f4e14d6aa47dd87f05357cb5)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.803897 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.805637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 122/244] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.814009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.864995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566cc9e-50c6-45c9-984e-c619a447c23e None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.876221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.904044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.904998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.905475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.905964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.907006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.908750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b228dd73-5e81-4b7f-962e-710101b056a2 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.930191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.992165 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 123/245] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:56 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:56.997321 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b7216-52cd-4894-bda8-5738f98f7c37 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.054552 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.055590 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.056127 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.056601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.150410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.152664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.210936 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.225703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be473-9837-4fc0-94ec-8a5c95c24a42 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.226190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be473-9837-4fc0-94ec-8a5c95c24a42 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.226674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632be473-9837-4fc0-94ec-8a5c95c24a42 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.229584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 124/246] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:57.239203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.239606 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.240014 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.276710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:57.278947 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:57.307572 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 123/247] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:57.316173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.403044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 125/248] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:57.404352 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.483189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffa231-f799-40a6-ba2a-62078182aa94 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.528228 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.528974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.529259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.529537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.537316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.544140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2bbe6c-ff7e-4438-8489-4f865c0f49c8 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.548966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-78aba080-8891-4a1e-9692-a733abe5d0d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:57.561689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.563668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:57.565445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:52:57.568390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 124/249] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.574192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420cfc7-9fcc-48b6-a9b2-feb51bf780dd None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.574192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420cfc7-9fcc-48b6-a9b2-feb51bf780dd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.574192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420cfc7-9fcc-48b6-a9b2-feb51bf780dd None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.574192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 125/250] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:52:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:57.575742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420cfc7-9fcc-48b6-a9b2-feb51bf780dd None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.586976 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.587881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.588947 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.588947 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.589285 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.590646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.592319 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e00dfd-6091-4130-852d-b2364cf67f59 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.594985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 126/251] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.596473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.596819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.598958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.620675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:57.621926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:57.717871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 127/252] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:57.722263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.759626 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420cfc7-9fcc-48b6-a9b2-feb51bf780dd None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.833025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.833567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.833886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.834155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.834842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:57.835146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.836584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.847300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 126/253] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.853246 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.908347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0beaf-81f4-4ce0-8f2e-4531c6bd79a8 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.917494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.947800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.948473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.948756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.949030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.949882 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=e3ce89a8f4e14d6aa47dd87f05357cb5) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:57.950205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.951757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.958601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 128/254] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/role_assignments?user.id=e3ce89a8f4e14d6aa47dd87f05357cb5&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=32e2b5a3107f491691d78f63832eae41 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.959461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.009986 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.069418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539599a-ce9c-456f-bd5f-98f2a7d17177 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.145234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.146733 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.146733 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.146733 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] PATH_INFO: `/v3/users/178bb227db314cbb90e956931dc16e07` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.147835 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] RBAC: Authorizing `identity:get_user(user_id=178bb227db314cbb90e956931dc16e07)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.149324 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.158052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 127/255] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/users/178bb227db314cbb90e956931dc16e07 => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.159047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.198956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eef9d-17c2-4b4e-a2d4-6ed643b72c74 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.279603 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.280737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.281835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.282346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.304787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:58.317563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.318636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:58.319439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:58.324651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 129/256] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.330702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.372757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.380306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e0f0e-944e-4d2f-bcfb-3d701ef5e13d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.423030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.424027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.424570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.425173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.426748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.428462 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.430593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 128/257] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.431705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.438484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.534476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b47c167-a406-4b63-b495-8472a359a1b7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.583967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578ea5b-101e-49e9-be70-adba91d2a9f9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.637487 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.638440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.638588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.638930 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.657298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.658921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.659660 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.660388 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.662016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.662847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.665092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:58.666183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:58.671059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.673407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 130/258] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.676764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.693967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 129/259] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.701690 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.847463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.920293 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.925190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c7eaf-a41c-4371-a42e-c81416a90f6a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.977562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffd8ee-bd9b-40c0-9ebe-1f085ae14e0f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.002412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.003042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.003324 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.003598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.007230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.007230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.007230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.015437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 130/260] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.016429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.068400 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.069095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.069376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.069844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/178bb227db314cbb90e956931dc16e07/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.071878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, user_id=178bb227db314cbb90e956931dc16e07, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.073375 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.139891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d5e44-ec56-4881-a8f6-07b4601eea33 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.171776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.183920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.184471 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.184749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.185021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.187251 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.188730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.190439 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 131/261] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.191277 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.195247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 131/262] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:58 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/178bb227db314cbb90e956931dc16e07/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:59.210027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.415088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e0cc0-1f38-4b17-9615-516e41ea4345 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.534048 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63de996-a5e4-4664-89db-9b5d7eb6feb5 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.587927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.589100 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.589663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.590580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] PATH_INFO: `/v3/users/2dfc6238fc8546bca58e207f8cecf55a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.601780 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] RBAC: Authorizing `identity:get_user(user_id=2dfc6238fc8546bca58e207f8cecf55a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.604338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.606901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.607682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 132/263] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users/2dfc6238fc8546bca58e207f8cecf55a => generated 283 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.609143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.609975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.610745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.614231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.619207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.745944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.768757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.772973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.842088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e92be-4d9d-4538-9699-1159a56e30f0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.907230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.907666 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.907936 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.908201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.994941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 132/264] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 786 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:00.004827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.076117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.127364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.130494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.215655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f8d746-3fdc-4b87-ad75-2c25b45da677 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.307694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.320382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.321929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.322841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.323611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.326185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.329348 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.332917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 133/265] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:00.343284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.429131 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 133/266] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 816 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:00.435120 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.544231 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd225f-ddc6-4727-9a1f-28c10c450eec None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.549230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.617241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.618330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.618805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.619376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.620719 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=2dfc6238fc8546bca58e207f8cecf55a) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:00.621238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.624061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0d4-38c1-4092-9935-203da861ab71 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.636815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 134/267] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/role_assignments?user.id=2dfc6238fc8546bca58e207f8cecf55a&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:00.735672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d85e-75a5-4d15-9781-e82072af8d5c None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.737656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d85e-75a5-4d15-9781-e82072af8d5c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.737656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0d85e-75a5-4d15-9781-e82072af8d5c None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.747280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 135/268] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:00.757997 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.758401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.758555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.792572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:00.793817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:00.826795 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b99341e-b791-4997-83cf-28acf5b12a21 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.925297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 136/269] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:00.949956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.950627 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.950917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.951176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.958637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.960880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445eaecf-fadc-4b86-b03c-c6635a413a0d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.968987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 134/270] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:00.970353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.111897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445a5ef-1716-4a62-aa57-eb4e22c1d5ef None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.113649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.157265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.157916 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.158196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.158530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.159277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] RBAC: Adding query filter params (role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=2dfc6238fc8546bca58e207f8cecf55a) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:01.159581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.161057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44aa1e1-0906-400f-89a1-aaecdd18c1d1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.171801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 137/271] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/role_assignments?user.id=2dfc6238fc8546bca58e207f8cecf55a&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=525e28a76eea45b0831b88775497b08f => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:01.606503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc44b3-7a75-495c-9ae1-f07dd97564ce None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.606758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc44b3-7a75-495c-9ae1-f07dd97564ce None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.607143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc44b3-7a75-495c-9ae1-f07dd97564ce None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.608730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 135/272] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:01.614221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a94a-84fe-4055-a0ac-d0bf4d026516 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.614593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a94a-84fe-4055-a0ac-d0bf4d026516 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.614836 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a94a-84fe-4055-a0ac-d0bf4d026516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.641928 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-dcb2a94a-84fe-4055-a0ac-d0bf4d026516 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.643300 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-dcb2a94a-84fe-4055-a0ac-d0bf4d026516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.717139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc44b3-7a75-495c-9ae1-f07dd97564ce None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.731366 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 138/273] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:01.748369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c91a-5908-4d32-b132-7547df339085 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.748369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c91a-5908-4d32-b132-7547df339085 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.748369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367c91a-5908-4d32-b132-7547df339085 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.748369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 139/274] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:01.758656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.758912 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.759238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.781781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.782986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.794144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.903718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 140/275] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:01.944018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdc44b3-7a75-495c-9ae1-f07dd97564ce None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.010049 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.011398 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.012070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.012727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.033658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:02.043752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:02.045937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:02.051288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:02.053903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 136/276] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:02.061212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.099578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.196999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd8d69-f919-4133-924b-c900df271bd7 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.240437 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.241488 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.241998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.242461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.243596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.244149 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.245908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.257078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 141/277] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.269529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.364376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.452367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.470310 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e54a9-8602-4eaf-8367-7490781087fc None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.480847 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.502559 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8f3c6-4d70-48ca-896b-f16f12e65613 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.521124 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.521713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.521991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.522259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] PATH_INFO: `/v3/users/871fbc8296604cef84d1373d2dadad38` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.540157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] RBAC: Authorizing `identity:get_user(user_id=871fbc8296604cef84d1373d2dadad38)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.542185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.544257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 137/278] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/users/871fbc8296604cef84d1373d2dadad38 => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.544999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.573294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.574406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.574903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.575384 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.607581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:02.617321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:02.618573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:02.619393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 142/279] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:02.620908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.688896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d2ef9-6e18-4155-ad77-f6886ab0437a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.732375 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.733036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.733319 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.733597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.734879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.736321 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.738229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 138/280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.742691 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.750833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee82d1-ac1f-4684-ab67-6f6991677f51 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.772730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.800698 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.801517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.801909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.802308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.803059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, user.id=871fbc8296604cef84d1373d2dadad38, scope.system=all) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.803371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.804868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.810404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 143/281] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/role_assignments?user.id=871fbc8296604cef84d1373d2dadad38&scope.system=all&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.811216 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.831299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.871351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93deba-9109-4151-a813-2e26f0b9efe5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.918442 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.919076 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.919354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.919624 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.920325 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.920625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.922107 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd406bc7-e255-4779-b0b2-86536e397a78 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.937487 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 139/282] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.941817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c79b-42ca-4f29-bcd8-811310d84e81 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.942117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c79b-42ca-4f29-bcd8-811310d84e81 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.942379 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259c79b-42ca-4f29-bcd8-811310d84e81 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.947443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 140/283] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:02.947443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c79b-42ca-4f29-bcd8-811310d84e81 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.973555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03038c-d680-4b56-8e15-480a48b1c4b3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.022187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.022851 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.023078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.023345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.023991 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.025460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.048222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.068275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259c79b-42ca-4f29-bcd8-811310d84e81 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.104605 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.105251 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.105524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.105838 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] PATH_INFO: `/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.107172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] RBAC: Authorizing `identity:get_user(user_id=e3ce89a8f4e14d6aa47dd87f05357cb5)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.108636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a52e3f-83fb-4197-8eef-9e36aebc698f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.110975 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 141/284] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.112101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.112431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.112703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.131666 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:03.132859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:03.150091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 144/285] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/users => generated 293 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:03.153111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.235760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 142/286] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:03.269999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.308245 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea91fce-cbb9-4df5-8a25-f5edb3aa60cf None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.349179 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.350268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.350550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.350827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.352012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.353520 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.355432 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 145/287] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.361902 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.458170 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.495271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a67c97-939a-4dd6-abef-28ab225430cb None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.540516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.541204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.544018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.544018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/e3ce89a8f4e14d6aa47dd87f05357cb5/roles/32e2b5a3107f491691d78f63832eae41` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.546122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, user_id=e3ce89a8f4e14d6aa47dd87f05357cb5, role_id=32e2b5a3107f491691d78f63832eae41)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.548205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.611777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.639609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 143/288] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:03 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/users/e3ce89a8f4e14d6aa47dd87f05357cb5/roles/32e2b5a3107f491691d78f63832eae41 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:03.757168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cdf03-4628-40a3-9c4c-7f1fbfd9cbf8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.799214 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.804675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.805316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.805591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.805887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.819231 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:03.824678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.825690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:03.826521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 146/289] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:03.832223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.984666 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fa77c-8bfd-4745-adf4-bb133c4b268f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.026899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.027515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.027786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.028322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.028992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:04.029284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.030710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.037635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.041574 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 144/290] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:04.046977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.204172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef433a99-8274-4a43-8ae9-bb5c301037ed None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.240903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.241457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.241767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.242040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] PATH_INFO: `/v3/users/178bb227db314cbb90e956931dc16e07` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.243251 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] RBAC: Authorizing `identity:get_user(user_id=178bb227db314cbb90e956931dc16e07)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.244695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.246506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 147/291] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/users/178bb227db314cbb90e956931dc16e07 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:04.251960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.420705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50bd9e1-d098-4930-be43-563bb01cfabb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.488107 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.488735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.489013 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.489288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.583381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.590227 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.592029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.778939 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 145/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:04.788297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.888927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.951241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2edede-f8d5-4994-ad37-14b240a02d52 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.993387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.994070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.994354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.994627 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.995813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.997265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a592-ee50-436f-b934-dd863d43dc7b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.999180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 148/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.005592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.160090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.163771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac52b2-e7f8-410c-b296-eeb72197db39 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.211711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.212337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.212614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.212886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.213830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=178bb227db314cbb90e956931dc16e07) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.214141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.215609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b3d85-4dfb-45be-abe0-1abb7d3ee1c7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.226428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 146/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/role_assignments?user.id=178bb227db314cbb90e956931dc16e07&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.723005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7f0d-30e6-4caa-bc6c-8a2d8c7b467a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.723516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7f0d-30e6-4caa-bc6c-8a2d8c7b467a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.723516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7f0d-30e6-4caa-bc6c-8a2d8c7b467a None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.725303 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 149/295] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:05.732833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed0c7-71a1-411d-bbfa-d52eded0b103 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.733109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed0c7-71a1-411d-bbfa-d52eded0b103 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.733379 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ed0c7-71a1-411d-bbfa-d52eded0b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.755681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-891ed0c7-71a1-411d-bbfa-d52eded0b103 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:05.756993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-891ed0c7-71a1-411d-bbfa-d52eded0b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:05.846986 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 147/296] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:06.075198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23d604-fb75-4f43-b039-accdfa320fca None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.075198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23d604-fb75-4f43-b039-accdfa320fca None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.075198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23d604-fb75-4f43-b039-accdfa320fca None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.075198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 150/297] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:06.089480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.090038 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.090497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.124392 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.127294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.151074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260b87-f2e0-44dc-baa3-144ad0a0066d None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.151636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260b87-f2e0-44dc-baa3-144ad0a0066d None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.152101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e260b87-f2e0-44dc-baa3-144ad0a0066d None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.156078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 151/298] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:06.166030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.166531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.166890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.200172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.202542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.219340 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 148/299] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:06.223003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.275545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.304429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 152/300] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:06.377294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a47a6-fdd3-4cfc-8c54-217d6edd8dae None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.415500 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.416503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.416990 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.417546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.430165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:06.435560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.436512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:06.437328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:06.440381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 149/301] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.446402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.518606 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.563774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb314a-799c-429b-a396-7971002e9b24 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.571764 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.606732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.607631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.607909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.608670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.609984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:06.610296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.612448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.629720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 153/302] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:06.635445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.689229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.707362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b9879-e20f-419c-a84b-7e588f7120ad None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.760560 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.761530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.762095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.763209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.771406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1700ff-2c36-44ad-863d-df4ed779bf01 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.783705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:06.793339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.794522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:06.795634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 150/303] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.796873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.802649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.818817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.819463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.819743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.820015 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] PATH_INFO: `/v3/users/871fbc8296604cef84d1373d2dadad38` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.821224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] RBAC: Authorizing `identity:get_user(user_id=871fbc8296604cef84d1373d2dadad38)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.822733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.824722 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 154/304] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/users/871fbc8296604cef84d1373d2dadad38 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.825636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.932079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18401d57-c7e4-4294-bafb-dcdb4fc6a1e4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.939928 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5fb5ea-7d19-474a-a02c-6ed9a868bd30 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.975111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.976355 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.976575 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.976691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.976927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.977211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.977489 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.977764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:06.977884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.978068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.978932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.980385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.980550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d54e05c-7012-47d8-8092-fb60d2f2b976 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.982088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 151/305] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.982861 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.992354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 155/306] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.993848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10974f5c-15dd-4971-a1aa-d1fa2bf738a6 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.994135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10974f5c-15dd-4971-a1aa-d1fa2bf738a6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.994402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10974f5c-15dd-4971-a1aa-d1fa2bf738a6 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.996035 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 156/307] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:06.998626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10974f5c-15dd-4971-a1aa-d1fa2bf738a6 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.003835 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.089597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069845c-b139-4e6f-a360-490632e48035 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.121157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.123185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10974f5c-15dd-4971-a1aa-d1fa2bf738a6 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.132235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.134167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.134469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.135337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] PATH_INFO: `/v3/system/users/871fbc8296604cef84d1373d2dadad38/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.137840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=871fbc8296604cef84d1373d2dadad38, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.139765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.163220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.163584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.163937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] PATH_INFO: `/v3/groups` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.164653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.166268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ca732-b211-489f-8b82-efcaf9d925fc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.262077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 152/308] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Aug 18 20:53:06 2022] PUT /identity/v3/system/users/871fbc8296604cef84d1373d2dadad38/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:07.262906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.351015 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 157/309] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/groups => generated 229 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:07.352649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.353052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.353286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.377839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:07.379435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.398807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.459039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0cb84-1410-48c2-8612-2130133e7e3a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.524493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.525054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.525360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.525665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] PATH_INFO: `/v3/users/ccc6410b520b4620b709576c7961348b` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.530000 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 158/310] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:07.551130 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] RBAC: Authorizing `identity:get_user(user_id=ccc6410b520b4620b709576c7961348b)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.553054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.555063 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 153/311] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/users/ccc6410b520b4620b709576c7961348b => generated 293 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.563028 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.643811 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.719708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6fdacd-33b9-4242-8e4f-3f83c32d4c0a None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.820483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.821460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.821855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.822326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.823560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, user.id=ccc6410b520b4620b709576c7961348b, scope.system=all) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.824080 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.826671 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.835923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 159/312] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/role_assignments?user.id=ccc6410b520b4620b709576c7961348b&scope.system=all&role.id=32e2b5a3107f491691d78f63832eae41 => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.992561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.140200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacf4ca-5218-40e8-a3d3-df8d98e5a1ac None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.182780 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.183425 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.183916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.184134 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.186278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.198114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:08.203055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:08.206811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:08.209539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 154/313] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:08.219257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.448184 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23f3e8-f51d-484b-b450-7b6c74e7eb0a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.452846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.518163 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.519669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.520437 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.521172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.522699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.523551 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.526445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.544450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 160/314] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.551131 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.671958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123f64f-b599-4189-859d-ea60b54fac2f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.715094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.715646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.715919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.716194 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] PATH_INFO: `/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.717509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] RBAC: Authorizing `identity:get_user(user_id=e3ce89a8f4e14d6aa47dd87f05357cb5)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.719161 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.725934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 155/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/users/e3ce89a8f4e14d6aa47dd87f05357cb5 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.727611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.914265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b97af9-cb4d-443b-b245-6c65213e4b29 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.980684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.982241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.983043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.983796 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.054018 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.118828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.121582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.324541 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 161/316] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:09.330871 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.409225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.450056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536b161-d993-4fc5-9328-18d38e0e7134 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.487793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.488487 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.488767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.489725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.491372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.493597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de02237b-f494-4fa2-a4b1-d24f71eaf520 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.501744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 156/317] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:09.505142 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.589157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.630593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c500d-d5f2-49ad-b70a-46b2cd60bac1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.670894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.671523 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.671802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.672170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.673160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9, user.id=e3ce89a8f4e14d6aa47dd87f05357cb5) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:09.673470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.674993 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f54f9-7527-4709-ad0a-8c5466fa50c6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.682019 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 162/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/role_assignments?user.id=e3ce89a8f4e14d6aa47dd87f05357cb5&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=32e2b5a3107f491691d78f63832eae41 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:10.113368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1ba8-08a6-40f3-9022-5dd23f9cf771 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.114415 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1ba8-08a6-40f3-9022-5dd23f9cf771 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.115079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c1ba8-08a6-40f3-9022-5dd23f9cf771 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.118494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 157/319] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:10.124153 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb356-4a91-41f0-963d-610b5b82ef79 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.124953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb356-4a91-41f0-963d-610b5b82ef79 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.124953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cb356-4a91-41f0-963d-610b5b82ef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.144931 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-1a2cb356-4a91-41f0-963d-610b5b82ef79 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:10.146213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-1a2cb356-4a91-41f0-963d-610b5b82ef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.232875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 163/320] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:10.280090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb10c9-6fd9-4a7c-9f9c-926f807435c7 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.280380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb10c9-6fd9-4a7c-9f9c-926f807435c7 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.280690 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb10c9-6fd9-4a7c-9f9c-926f807435c7 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.282955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 158/321] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:10.288448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.288741 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.289026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.308109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:10.309317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.380812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.397764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:10.577736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb10c9-6fd9-4a7c-9f9c-926f807435c7 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.703416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb10c9-6fd9-4a7c-9f9c-926f807435c7 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.738722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.745670 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.746374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.746673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.746926 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.759544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:10.764767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:10.766145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:10.767513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:10.769715 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 159/323] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:10.773097 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.955614 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa6c6-eaf9-4fd7-b8b9-21f43c523e04 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.017887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.020571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.021337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.021817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.022236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.023439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.023927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.026722 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.045351 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 165/324] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:11.048263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.155741 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.176650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5d41-4a98-472c-bb5a-a927efa1d066 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.217414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.218002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.218280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.218550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.220307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.221841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09906a-1e7e-42f0-ae75-7e7cc8057a60 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.223508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 160/325] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:11.224744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52f35-c4e9-41c4-9fcb-22dca6ce2410 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.225042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52f35-c4e9-41c4-9fcb-22dca6ce2410 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.225297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c52f35-c4e9-41c4-9fcb-22dca6ce2410 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.226946 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 161/326] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:11.231580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c52f35-c4e9-41c4-9fcb-22dca6ce2410 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.248215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ddc0-94d2-44a1-94a9-a18e7062b08a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.303680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.325207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.326257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.326612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.327060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] PATH_INFO: `/v3/users/871fbc8296604cef84d1373d2dadad38` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.328643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] RBAC: Authorizing `identity:get_user(user_id=871fbc8296604cef84d1373d2dadad38)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.330473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf09d8e3-a382-495c-bb8e-0ccaed4e313e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.332763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 166/327] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/users/871fbc8296604cef84d1373d2dadad38 => generated 293 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:11.338957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.338957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.338957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.366956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c52f35-c4e9-41c4-9fcb-22dca6ce2410 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.367352 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:11.368751 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.411166 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.411812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.412094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.412367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] PATH_INFO: `/v3/groups` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.413017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.414713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.485178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 167/328] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:11.486017 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.534804 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 162/329] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Aug 18 20:53:11 2022] POST /identity/v3/groups => generated 226 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:11.564949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.665257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88859680-bb2f-4858-9228-7c0affda7b18 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.732185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.733144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.733571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.734037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.735434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] RBAC: Adding query filter params (role.id=2ee117d96f4b4c519e43c0e588fa600c, user.id=871fbc8296604cef84d1373d2dadad38, scope.system=all) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.735840 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.738447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.763075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 168/330] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/role_assignments?user.id=871fbc8296604cef84d1373d2dadad38&scope.system=all&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 510 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:11.829875 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.014106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790df12-059d-4242-af91-2bb508319df8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.044467 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:12.073961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.074631 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.074907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.075182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.090776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:12.096542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:12.098971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:12.100732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 163/331] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:12.103812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.275552 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba8b6f-1e49-41e6-aa07-3cd90438d6d1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.288579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:12.346243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.348156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.349056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.349764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.351412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:12.352070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.364353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.383729 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 169/332] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:12.390094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.597798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b63c-6efb-40ce-a309-fcc7e9136c36 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.678298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.679480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.679970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.680460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] PATH_INFO: `/v3/users/ccc6410b520b4620b709576c7961348b` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.684135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc6410b520b4620b709576c7961348b)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.686980 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603f5d7-bea4-4619-bc58-1d9cee486e50 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.691141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 164/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:12 2022] GET /identity/v3/users/ccc6410b520b4620b709576c7961348b => generated 293 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:12.696693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:12.854073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16ad5a-8223-40f6-9467-b413534441a7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.901056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.901780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.902067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.902350 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] PATH_INFO: `/v3/system/users/ccc6410b520b4620b709576c7961348b/roles/32e2b5a3107f491691d78f63832eae41` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.904211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ccc6410b520b4620b709576c7961348b, role_id=32e2b5a3107f491691d78f63832eae41)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.905666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cf94d9-a4c9-496f-a288-b3d6f38918f1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.994497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 170/334] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Aug 18 20:53:12 2022] PUT /identity/v3/system/users/ccc6410b520b4620b709576c7961348b/roles/32e2b5a3107f491691d78f63832eae41 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:14.962278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a759c-090a-4351-9799-1c197cc2cf14 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.962854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a759c-090a-4351-9799-1c197cc2cf14 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.962854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a759c-090a-4351-9799-1c197cc2cf14 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.964609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 165/335] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:14.970501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30495987-618a-464d-8f09-60594305b60f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.971499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30495987-618a-464d-8f09-60594305b60f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.971983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30495987-618a-464d-8f09-60594305b60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.003483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-30495987-618a-464d-8f09-60594305b60f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:15.005487 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-30495987-618a-464d-8f09-60594305b60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:15.051251 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.109193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:15.379678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ad53-e2a2-49a3-89c2-fb9c271360c2 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.379964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ad53-e2a2-49a3-89c2-fb9c271360c2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.380248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628ad53-e2a2-49a3-89c2-fb9c271360c2 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.381783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 166/337] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:15.388553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf74-64c5-497e-b7c2-4e5632f69f07 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.389199 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf74-64c5-497e-b7c2-4e5632f69f07 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.389706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedf74-64c5-497e-b7c2-4e5632f69f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.414650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-f7aedf74-64c5-497e-b7c2-4e5632f69f07 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:15.416381 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-f7aedf74-64c5-497e-b7c2-4e5632f69f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:15.516524 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 172/338] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:15.674967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628ad53-e2a2-49a3-89c2-fb9c271360c2 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.743622 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.792733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327e1b-91c6-4332-bd0a-0f79dad7ec63 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.793401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327e1b-91c6-4332-bd0a-0f79dad7ec63 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.793926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88327e1b-91c6-4332-bd0a-0f79dad7ec63 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.795938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 173/339] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:15.803293 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.805112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.805646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.827219 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628ad53-e2a2-49a3-89c2-fb9c271360c2 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.844736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:15.849922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:15.921834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.922781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.926031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.926565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.951724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:15.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:15.963891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:15.964709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:15.967541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 167/340] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:15.981803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 174/341] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:15.988685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.135414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585e73c-d256-4d82-9b35-4c315bc8d646 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.157508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.195826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.196462 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.196755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.197028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.197833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:16.198174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.199634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.210982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 168/342] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:16.217696 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.278511 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.389266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7594d49-79e2-4370-b3e1-5bf2477ea9a3 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.437072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.437746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.438033 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.438313 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.524870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.542526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.544036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.583198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.698504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1500357-0be4-47cb-92a8-6de4294cdab6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.747692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 175/343] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:16.748996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.755211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.756174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.756457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.756730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.772287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-08cbd7fb-3902-4dbb-8b56-b52a3120791e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:16.778913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:16.780152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:16.781023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 169/344] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:16.785217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b324-ad94-47e3-9b64-67e91374709d None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.785217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b324-ad94-47e3-9b64-67e91374709d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.785217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2b324-ad94-47e3-9b64-67e91374709d None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.787117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 170/345] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:16.787270 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2b324-ad94-47e3-9b64-67e91374709d None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.837762 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.944724 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b328b5b9-eb85-462b-bc26-b0333428f1bb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.970102 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2b324-ad94-47e3-9b64-67e91374709d None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.983898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.010440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.010440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.010440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.010440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.017776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.018405 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.018786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.019162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.021597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.022113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:17.023536 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e508434-1780-4efd-8f3b-168cf750e42b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.025595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 171/346] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.026981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.027437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.027839 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:17.029008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.030309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:17.031166 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:17.034115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 176/347] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.035146 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.055298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:17.056831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.150888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 172/348] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:17.151229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.183393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.270200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd2ba4-419d-40df-afc9-73aa76706b4b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.306160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb98cdf-bb7f-4cc4-9cb7-b4f45ba8deb8 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.344273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.346716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.347513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.348223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.349885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.350676 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.353732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.361944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.362607 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.362887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.363156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.370511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.372027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.375505 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 177/349] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.377553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.378793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 173/350] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.380152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.499949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.512224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a55a5-baf4-464f-bc41-cc022aa31944 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.537136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.578400 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.579042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.579353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.579696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.608181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744375a5-6fcd-4de0-9a63-e2494f5aba00 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.683508 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.684566 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.685055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.685519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.686755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.687203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.690337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.710933 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.712841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce117a6-8592-4a5c-b89f-92819aaf9a3f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.713884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 178/351] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.715501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.868704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.884568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 174/352] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:17.886391 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98176-8728-4977-80cb-30cfd7b583ba None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.886974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98176-8728-4977-80cb-30cfd7b583ba None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.887252 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98176-8728-4977-80cb-30cfd7b583ba None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.888868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 175/353] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:17.889503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98176-8728-4977-80cb-30cfd7b583ba None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.901371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e784d1-f841-435a-b5c8-dc659c279329 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.925387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.974751 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.975796 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.976293 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.976809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.978275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.978828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.983045 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.994390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 179/354] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=525e28a76eea45b0831b88775497b08f => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.996001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.036961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98176-8728-4977-80cb-30cfd7b583ba None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.085424 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.086266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.086646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.087789 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.199620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca44c-85f7-4aaa-97db-663e0d8627da None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.202723 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.225860 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.229335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf02da-d897-455d-8bec-24a136d5675f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.245470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.246170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.246449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.246725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.266360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-c7b4cff7-99bc-41a3-9b2d-4023225d1e79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:18.272783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:18.274646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 180/355] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:18.276240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.277703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.277703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.303324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:18.304579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.346063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.416152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 181/356] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:18.418016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.458899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 176/357] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:18.461184 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7034c0-f430-4dab-8198-0d4a852ed663 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.467265 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7034c0-f430-4dab-8198-0d4a852ed663 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.467892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7034c0-f430-4dab-8198-0d4a852ed663 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.470929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 177/358] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:18 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:18.472291 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7034c0-f430-4dab-8198-0d4a852ed663 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.653446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53578dc-a1ec-4d06-977b-e9aa8191cbe6 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.683861 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.717271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7034c0-f430-4dab-8198-0d4a852ed663 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.746247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.746860 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.748762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.748762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.754006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.759498 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.761655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 182/359] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.762023 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.828742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.830507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.831651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.832417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.833249 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.834698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.835194 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.837879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f7a0ef-0d18-41c2-819c-57b22548c7eb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.861703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 178/360] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.861703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.861703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.861703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.890760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:18.894218 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:18.996869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1cf82-2a34-4c06-aec7-e10a8a4563bc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.037707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 179/361] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:19.040247 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.075161 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.076709 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.077428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.078240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.081547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.084960 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.088737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 183/362] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.095459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.241062 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.287441 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b068e7-97ec-4d8a-8b25-c5c77c76aff1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.330501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.338770 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede90f28-0d82-4dbe-bc1d-da56a5dfd8db None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.379122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.380275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.380867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.381368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.384426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.387344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.388820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.389470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.389801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.390404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.391181 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 180/363] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.397800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.404313 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:19.411091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:19.412074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:19.412914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 184/364] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:19.414147 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.560737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5174ce2-bf64-4ae4-906e-e41cbfa07a89 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.638925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c654c1-e8c6-4195-8f5a-8596519b79e6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.640387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.641219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.641710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.642270 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.643748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.645416 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.647638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 185/365] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.648676 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.691541 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.710325 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.710954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.711233 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.711502 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.736073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.843138 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.847463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.856696 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e94ece-cb51-4df0-8175-160f30d23883 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.931055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.931911 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.932345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.932816 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.934244 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:19.934733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.937413 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.949648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 186/366] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.951148 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.014573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 181/367] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:20.017592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.110779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.181506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.188676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fec2746-a3cb-400a-83c3-7b1f63520794 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.200548 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b1d059-769e-47df-a02a-2aab43c0edc3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.257192 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.258523 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.259181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.259677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.260624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.261238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.263091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.268144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.269380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.269943 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.270430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.276098 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 187/368] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.277338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.304503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:20.319057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:20.320071 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:53:20.320880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:20.322035 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 182/369] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:20.323966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.467349 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d524b8-b316-473c-967e-846e30bbd34c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.481710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.499305 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdea9f-e2b6-486b-90a7-46812de82e1b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.520450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.521241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.521592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.522012 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.523459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.525864 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.527831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 183/370] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.531825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.605795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.607613 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.608321 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.609586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.611194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.611966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.616862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.634486 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 188/371] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 260 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.637029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.686918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.736151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc13d3-5d1c-4ce7-8462-87214f97a365 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.850885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.851320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.853078 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.853078 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.890923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525ea3c-ccf3-4845-9892-255e606148f7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.967742 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.969191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.969979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.970705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.972241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.973459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.976625 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.997460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 189/372] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.999483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.032559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.062284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.065540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86222ff4-ecf9-4427-8ae0-d7b3f6b3e39a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.185336 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.227066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d47309-5338-4ae0-8630-a75d85210591 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.301043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.302263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.302780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.303356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.305704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.308473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.318196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 190/373] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.319807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.333119 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 184/374] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:21.335440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75a92-716f-4535-a829-b1bf9a977b43 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.335921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75a92-716f-4535-a829-b1bf9a977b43 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.337689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e75a92-716f-4535-a829-b1bf9a977b43 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.339220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 185/375] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:21.340678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e75a92-716f-4535-a829-b1bf9a977b43 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.527955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.560395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b883cb-f3e2-41db-b787-114b174630c2 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.574947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e75a92-716f-4535-a829-b1bf9a977b43 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.630821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.632570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.633313 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.634094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] PATH_INFO: `/v3/users/ccc6410b520b4620b709576c7961348b` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.636584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] RBAC: Authorizing `identity:get_user(user_id=ccc6410b520b4620b709576c7961348b)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.639880 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.643926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 191/376] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/users/ccc6410b520b4620b709576c7961348b => generated 293 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.645755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.649143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.650198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.650737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.651171 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.652609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:21.653116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.656132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c7405-8bbc-43b2-a972-eb4fd047c5a2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.674131 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 186/377] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=525e28a76eea45b0831b88775497b08f => generated 260 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.676724 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.678312 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.678762 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.679224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.749986 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:21.752448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:21.885027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 187/378] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:21.894672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.904423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104f57d-624b-48e3-8b73-57537c7a3230 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.978099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.979398 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.980240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.980703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] PATH_INFO: `/v3/projects/adeaf2e8d52b44768681465c037dfd4a` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.987204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] RBAC: Authorizing `identity:get_project(project_id=adeaf2e8d52b44768681465c037dfd4a)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.990516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.998256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 192/379] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/projects/adeaf2e8d52b44768681465c037dfd4a => generated 344 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.007863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.166241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.255809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.277863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb89d3e-08ed-408a-8cbe-1af499d5fe9b None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.322873 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d00a2e-01e8-46c6-a087-c60e61250242 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.363959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.364603 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.364869 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.365142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.365932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] RBAC: Adding query filter params (role.id=32e2b5a3107f491691d78f63832eae41, user.id=ccc6410b520b4620b709576c7961348b, scope.system=all) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.379929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.379929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.405948 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 188/380] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/role_assignments?user.id=ccc6410b520b4620b709576c7961348b&scope.system=all&role.id=32e2b5a3107f491691d78f63832eae41 => generated 510 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.448506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.448506 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.448801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.449412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] PATH_INFO: `/v3/groups/ce9bae5fbd22446caf6f9f81327936af` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.471063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] RBAC: Authorizing `identity:get_group(group_id=ce9bae5fbd22446caf6f9f81327936af)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.473952 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.481392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 193/381] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/groups/ce9bae5fbd22446caf6f9f81327936af => generated 229 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:22.487739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.660905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941edab-b014-4061-83e8-96531eff1ae5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.665728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.755987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.775623 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.776833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.777257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.777773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.779114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] RBAC: Adding query filter params (group.id=ce9bae5fbd22446caf6f9f81327936af, role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=adeaf2e8d52b44768681465c037dfd4a) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.779639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.782896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.808673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 189/382] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/role_assignments?group.id=ce9bae5fbd22446caf6f9f81327936af&scope.project.id=adeaf2e8d52b44768681465c037dfd4a&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:22.985186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9278f-7f86-4bd1-94b8-dd40ae56f779 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.077666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.078635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.079098 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.082120 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.109331 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:23.128633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:23.130241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:23.131706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 194/383] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:23.132931 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.395511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c480450b-c98c-4157-b8e1-baf23e7682ed None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.484752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.485814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.486834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.487306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.488589 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.489182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.496286 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a706b1-e773-4b36-9d49-10d42c482b9f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.516372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 190/384] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.524399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.536529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33912-1254-4354-bad5-8bd29dcd1748 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.536922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33912-1254-4354-bad5-8bd29dcd1748 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.537881 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc33912-1254-4354-bad5-8bd29dcd1748 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.540420 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 191/385] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:23.553258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.554826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.555250 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.573101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.603233 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:23.605387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:23.702961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.727377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 192/386] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:23.764278 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffa00b4-5892-40b0-b3ed-1f1c2de8b5c7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.811064 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.811753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.812008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.812296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.813730 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.817317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.819446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 195/387] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.828373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.965694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4324dad8-4c39-4c18-aa62-b7aa30d4a36d None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.010716 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.011370 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.011651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.011924 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.013169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.014794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95707e44-e1e9-43e5-8212-e7f30d0f2eb5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.018694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 193/388] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:24.024785 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.217879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.278256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38b6f1-9cd9-47de-a14d-556d208713ad None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.358787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.360539 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.361984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.362757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/groups/6ea28f63532944b2928e8dfd552c490f/roles/525e28a76eea45b0831b88775497b08f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.369178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, group_id=6ea28f63532944b2928e8dfd552c490f, role_id=525e28a76eea45b0831b88775497b08f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.370599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908144-40ce-4fea-bec2-b6e44a7c7e5f None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.370890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908144-40ce-4fea-bec2-b6e44a7c7e5f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.371165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a908144-40ce-4fea-bec2-b6e44a7c7e5f None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.373270 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.374617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 194/389] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:24.380779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.381235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.382152 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.404507 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.406209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:24.478679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.484688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 196/390] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Aug 18 20:53:24 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/groups/6ea28f63532944b2928e8dfd552c490f/roles/525e28a76eea45b0831b88775497b08f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:24.486342 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.529766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 195/391] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:24.723170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59a71c-95c2-4c1d-9ccb-bb29e4dd194f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.798009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.799297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.799584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.799920 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.802666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.826073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:24.838619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:24.840783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:24.842558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:24.849924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 197/392] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:24.856461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.976040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.139188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d594b-7148-4ea9-baa5-06a87b43146d None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.215855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c5a5b-79b2-4fea-aa22-f2036b4cdcbe None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.261004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.261557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.261861 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.262181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.275927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:25.279866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.281460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:25.281999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:25.284423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:25.286087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 198/393] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:25.287918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.288681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.290292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:25.291054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.294116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.294476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.320095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 196/394] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:25.328785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.369759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.431263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd760f-58de-4886-b438-8ea57801e099 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.522419 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.564289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.566169 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.566675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.567135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.568344 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] RBAC: Adding query filter params (name=member) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:25.568857 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.572655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.608844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 199/395] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:25.618293 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.743397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfdc41-866b-4499-beb1-ef03f98575b5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.839153 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428711b6-6f39-4eba-b48e-cf0a1bf2c5de None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.844306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.845421 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.845928 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.846378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.848520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.859483 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.862979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.863541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 197/396] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:25.872791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.893969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.894996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.895502 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.896003 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.900169 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.902186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.904575 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 200/397] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:25.913429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.157548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc95e5ee-86a8-49fc-b2a7-b73e913808de None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.217880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.222800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d614-9778-48d5-993f-3c0894d3e35b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.278916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.280283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.280761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.281240 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.287170 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.290305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.292279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.293353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.293468 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 198/398] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:26.293881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.294372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.296657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.303027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.303027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 201/399] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:26.303216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.312587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.508470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.587856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee81d1-396f-471d-9006-ebe470776a83 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.677168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc01dc9-cda4-4de3-8abc-72e2f3b2b800 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.693659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.695234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.696935 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.697460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/groups/6ea28f63532944b2928e8dfd552c490f/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.702461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, group_id=6ea28f63532944b2928e8dfd552c490f, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.706893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf722793-8d01-4daf-b9e7-54afa2452f25 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.724391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.725267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.725518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.729497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/groups/6ea28f63532944b2928e8dfd552c490f/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.729497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] RBAC: Authorizing `identity:create_grant(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0, group_id=6ea28f63532944b2928e8dfd552c490f, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.729852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0284d8-49ef-4548-9e37-023d514e658b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.801019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 199/400] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Aug 18 20:53:26 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/groups/6ea28f63532944b2928e8dfd552c490f/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:26.802452 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d6ce-8bfe-4cca-8256-2ea0db7bf901 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.802736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d6ce-8bfe-4cca-8256-2ea0db7bf901 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.803005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d6ce-8bfe-4cca-8256-2ea0db7bf901 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.804617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 200/401] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:26.810688 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87871-caec-4c7e-8fe7-b797b6bea2f2 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.811129 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87871-caec-4c7e-8fe7-b797b6bea2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.811677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f87871-caec-4c7e-8fe7-b797b6bea2f2 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.814807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 201/402] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:26.820649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.821326 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.821637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.835907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 202/403] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Aug 18 20:53:26 2022] PUT /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0/groups/6ea28f63532944b2928e8dfd552c490f/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:26.837043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.837411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.841974 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.870334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.873645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.883225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.884831 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.003667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.056078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 203/404] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:27.129648 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 202/405] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:27.778406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.816744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.927416 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.094216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625927f9-96dd-4fbe-ac1b-de96aaa44ea3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.137927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.138602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.138880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.139158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.145690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3984c4-e6f6-48dd-a000-17207ae2f516 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.155440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:28.166484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:28.168578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:28.170385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 203/406] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:28.180220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.269204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.270342 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.270848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.271320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.302717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.320878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:28.344610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:28.346115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:28.346939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:28.350340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 204/407] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 573 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:28.356575 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.487748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5877535-6a84-43c5-b9bd-67729ae13aaf None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.572682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.573968 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.574460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.574936 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.576223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:28.576775 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.579538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.597385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 204/408] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:28.607096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.638597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d90fe1-2047-4205-9b15-256c4b8ac90c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.642305 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.699457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.700073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.700346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.700620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.701302 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:28.701702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.703217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada80f0e-fdb4-43ea-b6c8-4b4c6a6aeb1f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.718234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 205/409] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:28.720387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7ad-15f3-4a7f-89cb-d18ea8b74a14 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.721430 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7ad-15f3-4a7f-89cb-d18ea8b74a14 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.721967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9f7ad-15f3-4a7f-89cb-d18ea8b74a14 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.725106 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 206/410] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:28.726667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f7ad-15f3-4a7f-89cb-d18ea8b74a14 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.766291 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.772872 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a6c7d-cc8c-4252-a010-003f7b3f740a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.822078 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.822722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.823147 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.823497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.825545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.828611 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b43e66-6af3-47ea-beff-619b039311fa None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.832547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 205/411] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:28.839855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.840325 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.840812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.876225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:28.879062 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:28.910417 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9f7ad-15f3-4a7f-89cb-d18ea8b74a14 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.969574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.971091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.971717 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.974457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] PATH_INFO: `/v3/groups/ce9bae5fbd22446caf6f9f81327936af` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.976926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] RBAC: Authorizing `identity:get_group(group_id=ce9bae5fbd22446caf6f9f81327936af)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.979846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.983298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 207/412] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/groups/ce9bae5fbd22446caf6f9f81327936af => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:28.984832 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.991012 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 206/413] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:28.991966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.054998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.175828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.207136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df63d-9890-4fc7-b9a4-3d0075126bde None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.209792 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3743d18-ade2-40b2-99ac-ddd5bbf11a26 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.286213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.288756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.289990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.291026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.294456 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.297954 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.302454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 208/414] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:29.312943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.331173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.331173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.331566 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.331700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] PATH_INFO: `/v3/projects/adeaf2e8d52b44768681465c037dfd4a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.333095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] RBAC: Authorizing `identity:get_project(project_id=adeaf2e8d52b44768681465c037dfd4a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.334690 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.341665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 207/415] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/projects/adeaf2e8d52b44768681465c037dfd4a => generated 344 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:29.347153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.605140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.612056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade1e35-aa8c-4db1-b823-573c5a207372 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.664528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186bc44-e7de-4d1e-b015-9fdd4ca171bb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.680654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.682333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.683043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.683797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/groups/6ea28f63532944b2928e8dfd552c490f/roles/525e28a76eea45b0831b88775497b08f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.688393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] RBAC: Authorizing `identity:create_grant(project_id=1d87351cb7104e61a1d4d14434d54eb9, group_id=6ea28f63532944b2928e8dfd552c490f, role_id=525e28a76eea45b0831b88775497b08f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.691904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.710808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.715922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.715922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.715922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] PATH_INFO: `/v3/projects/adeaf2e8d52b44768681465c037dfd4a/groups/ce9bae5fbd22446caf6f9f81327936af/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.715922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] RBAC: Authorizing `identity:create_grant(project_id=adeaf2e8d52b44768681465c037dfd4a, group_id=ce9bae5fbd22446caf6f9f81327936af, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.715922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc4af85-b038-4fb1-a37f-ccdae7f6ddfa None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.791932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 209/416] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Aug 18 20:53:29 2022] PUT /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9/groups/6ea28f63532944b2928e8dfd552c490f/roles/525e28a76eea45b0831b88775497b08f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:29.799193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.824659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 208/417] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Aug 18 20:53:29 2022] PUT /identity/v3/projects/adeaf2e8d52b44768681465c037dfd4a/groups/ce9bae5fbd22446caf6f9f81327936af/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:30.016927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d61199-2a9a-4242-9808-ec873a525ddd None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.032918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7721-2b0d-4c8c-b3c8-b452efb95839 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.033890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7721-2b0d-4c8c-b3c8-b452efb95839 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.034857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff7721-2b0d-4c8c-b3c8-b452efb95839 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.037077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 209/418] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:30.045477 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75299-0194-4571-b9ff-739d49b7c0c1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.045865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75299-0194-4571-b9ff-739d49b7c0c1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.046262 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f75299-0194-4571-b9ff-739d49b7c0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.073363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.074418 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.074899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.075369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.089865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:30.096750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:30.097764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:30.098592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:30.101941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 210/419] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:30.107412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-82f75299-0194-4571-b9ff-739d49b7c0c1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:30.112656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-82f75299-0194-4571-b9ff-739d49b7c0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:30.114320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.138196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:30.183555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:30.293645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 210/420] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:30.394821 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3616a7-105d-48b0-8a98-e54a156c1164 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.395317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3616a7-105d-48b0-8a98-e54a156c1164 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.395787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3616a7-105d-48b0-8a98-e54a156c1164 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.403900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 211/421] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:30.404090 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082d1b7-7506-4efd-b226-a3bb7a44a613 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.406243 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.406763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.407204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.428795 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:30.430509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:30.500698 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.501324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.501599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.501957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.502718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:30.503017 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.504428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:30.524571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 211/422] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:30.545647 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.576072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 212/423] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:30.679483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:30.702305 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d048893-a504-45fb-be81-c74d4ed79542 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:30.756202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:30.756838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.757115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.757363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.900884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:30.903869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.000651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.146502 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.196928 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.201899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 212/424] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:31.204102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.220989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b0c40-4b19-4c5e-b03b-21e34f4954c1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.262254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.262961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.263441 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.263760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.276920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:31.282785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:31.285543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 213/425] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:31.288497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.403545 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999737b5-e8e9-4592-953d-ff8e0abf144b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.455693 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561faf7-62b1-4ee0-8afa-0f445d2615d8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.494980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.495659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.496122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.496604 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.496792 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.497087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.497382 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.497879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.499308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.500963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.504026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 214/426] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.505485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.523198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:31.524818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:31.534918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:31.541412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 213/427] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:31.542908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.628748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.651457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363b34d-4b31-492d-824c-81b319c3a095 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.702201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.702985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.703378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.703729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.704865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:31.705467 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.707659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.722322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 215/428] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.723222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.745866 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4093c4-a2ca-436e-87ea-2355150f8138 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.806171 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.816897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.820354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.820354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.820354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.822524 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.825556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.829701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 214/429] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.832247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.844351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fbbe8-2baf-4724-8228-c341cade57a4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.887492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.888297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.888619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.888989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.889822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] RBAC: Adding query filter params (name=member) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:31.890329 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.891867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.902727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 216/430] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.903798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.023047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144453d-9e3c-4181-8769-2d27fe766d88 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.041813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113e281-d80a-4d9f-8af4-724399512cd9 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.064021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.065194 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.065536 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.065911 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.066732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.067102 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.068621 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.070101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.074414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.077918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 217/431] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=525e28a76eea45b0831b88775497b08f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.080003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.131270 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.132520 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.133144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.133757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.212246 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029d773-2208-4cbb-b02e-abce36b1f390 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.257696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.258737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.259217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.259705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.323764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.326873 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.342068 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.354510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.357055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.514758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 218/432] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:32.521449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.569357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 215/433] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:32.576126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.601769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.634813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.641392 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92de8f-dc89-47fa-a872-10d1e8061931 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.682772 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.683669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.684089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.684498 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] PATH_INFO: `/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.686019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] RBAC: Authorizing `identity:get_project(project_id=2e476a2ae0bc4e99bc1e496f1f3f61d0)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.687791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.690963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 219/434] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/projects/2e476a2ae0bc4e99bc1e496f1f3f61d0 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.696304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.774868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279044e8-44b1-4951-bb58-c09878a6cd84 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.820870 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.821544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.821866 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.822143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.823404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.825011 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.831743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 216/435] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:32.833176 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.901929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e33b9-cbe3-48af-95d7-f146cb85bddc None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.950043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.950684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.950956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.951226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.952392 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.953964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8df6c-a70e-490b-accc-1d063357456f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.960683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 220/436] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.960683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74d3a-9ba3-4c77-9106-f30977434e7a None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.960683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74d3a-9ba3-4c77-9106-f30977434e7a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.960683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e74d3a-9ba3-4c77-9106-f30977434e7a None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.960683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 221/437] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:32.963862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74d3a-9ba3-4c77-9106-f30977434e7a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.968765 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.001493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebb4d6-ff22-4dcf-9b13-110fa0390af2 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.003230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.042272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.042917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.043190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.043458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.044629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.046255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e136b-6617-4ee3-9ff8-c13d5f5c6c65 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.048084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 217/438] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:33.049728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.050115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.050389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.076890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:33.079065 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:33.112083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e74d3a-9ba3-4c77-9106-f30977434e7a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.161026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.161971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.162383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.162838 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.164029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:33.164567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.166482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.185662 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 222/439] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=2e476a2ae0bc4e99bc1e496f1f3f61d0&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 611 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:33.185662 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.228999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 218/440] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:33.403734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.417308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8addc3-eec2-4a93-8ca1-fdc3a0fa1fcb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.486173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.487183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.487701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.488174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.489129 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=2ee117d96f4b4c519e43c0e588fa600c, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:33.489681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.491373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb238823-dbac-4bae-a015-638da0b15d99 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.504147 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 223/441] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=2ee117d96f4b4c519e43c0e588fa600c => generated 611 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:33.818649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.937710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.973335 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d91bb1-a14e-4369-b290-9f9dbb5e3a14 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.014349 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e86f7-ed5c-4cce-9a85-2aa35341fadf None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.014815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e86f7-ed5c-4cce-9a85-2aa35341fadf None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.015274 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e86f7-ed5c-4cce-9a85-2aa35341fadf None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.017838 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 224/442] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:34.026169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.027064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.027358 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.035230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.036309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.036777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.037253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.055764 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:34.056027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:34.057689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:34.060793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:34.062779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:34.064452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 219/443] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:34.078080 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.170232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 225/444] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:34.254019 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca545ac-9fa3-44f1-87d3-b1afb5b8384c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.314972 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.315938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.316420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.316889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.318157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.318698 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.321237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.325433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.337465 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 220/445] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:34.343802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.445320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.455264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6652-75b7-4c12-b910-fa69e37c4e0e None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.495767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.496382 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.496655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.496918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.577773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.579299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.585014 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.714634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.722967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e884df-71a0-4efd-a022-73fcb5e3d913 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.733508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 226/446] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:34.742964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.768159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.768786 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.769063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.769340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.781572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:34.787037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:34.788530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:34.790081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 221/447] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:34.795816 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.879143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceab60c-9d03-483f-b42c-03ac84380b9d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.895549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.928448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.929374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.929818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.930338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] PATH_INFO: `/v3/projects/adeaf2e8d52b44768681465c037dfd4a` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.932180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] RBAC: Authorizing `identity:get_project(project_id=adeaf2e8d52b44768681465c037dfd4a)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.934331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.937245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 227/448] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/projects/adeaf2e8d52b44768681465c037dfd4a => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:34.946022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.947333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83078c7-c46c-4f9e-8a58-73dc145348a8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.990148 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.990818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.991159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.991546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.992677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.993167 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.994830 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.005953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 222/449] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:35.013002 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.023052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.081197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde6776-8aa9-4b54-b839-f9ca4a3e0e96 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.124220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.124864 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.125138 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.125408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] PATH_INFO: `/v3/groups/ce9bae5fbd22446caf6f9f81327936af` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.126643 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] RBAC: Authorizing `identity:get_group(group_id=ce9bae5fbd22446caf6f9f81327936af)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.128883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.130724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 228/450] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/groups/ce9bae5fbd22446caf6f9f81327936af => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:35.137678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.162382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf687e8-206d-45d6-b5d2-a8c655ae2502 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.195290 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.219282 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.220292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.221311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.221794 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.262618 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24244b5-3794-4251-918c-b18b38603c33 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.294534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.308135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.308876 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.309213 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.317744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.317744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] RBAC: Adding query filter params (group.id=ce9bae5fbd22446caf6f9f81327936af, role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=adeaf2e8d52b44768681465c037dfd4a) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:35.317744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.317744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.321132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 229/451] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/role_assignments?group.id=ce9bae5fbd22446caf6f9f81327936af&scope.project.id=adeaf2e8d52b44768681465c037dfd4a&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:35.337733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.339566 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.476723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 223/452] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:35.483879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.661961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f148cf-0eb8-4950-885c-7d635239e0f8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.707633 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.708277 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.708559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.708835 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] PATH_INFO: `/v3/projects/1d87351cb7104e61a1d4d14434d54eb9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.710050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] RBAC: Authorizing `identity:get_project(project_id=1d87351cb7104e61a1d4d14434d54eb9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.711622 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.713348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 230/453] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/projects/1d87351cb7104e61a1d4d14434d54eb9 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:35.719479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.744340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.865988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb6537-27b3-4034-88f4-6916f9625c1f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.928167 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.929121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.929636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.930131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] PATH_INFO: `/v3/groups/6ea28f63532944b2928e8dfd552c490f` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.932065 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] RBAC: Authorizing `identity:get_group(group_id=6ea28f63532944b2928e8dfd552c490f)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.934784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f2f2e-ed02-4abd-8555-258d8ed528fc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.937758 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 224/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/groups/6ea28f63532944b2928e8dfd552c490f => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:35.944447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:36.012830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:36.061706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d4011-724a-4ac4-bac8-89b41ba8cfb3 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.101915 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.102537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.102819 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.103091 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.103847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] RBAC: Adding query filter params (group.id=6ea28f63532944b2928e8dfd552c490f, role.id=525e28a76eea45b0831b88775497b08f, scope.project.id=1d87351cb7104e61a1d4d14434d54eb9) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:36.104163 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.105678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f3ff2-50a6-4167-94f1-721f9480ee52 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.113520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 231/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/role_assignments?group.id=6ea28f63532944b2928e8dfd552c490f&scope.project.id=1d87351cb7104e61a1d4d14434d54eb9&role.id=525e28a76eea45b0831b88775497b08f => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:39.798687 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3eabd-1e11-4e38-9527-6108ad0cf5da None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.799573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3eabd-1e11-4e38-9527-6108ad0cf5da None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.799727 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3eabd-1e11-4e38-9527-6108ad0cf5da None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.802436 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 225/456] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:39.812037 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.813529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.814300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.846490 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:39.848917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.891587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce603-c71c-4868-85f9-4ab70da39931 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.892227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce603-c71c-4868-85f9-4ab70da39931 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.892485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fce603-c71c-4868-85f9-4ab70da39931 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.894825 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 226/457] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:39.903981 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.904988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.905758 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.942264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:39.944803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:39.953666 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 232/458] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:40.040431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 227/459] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:40.335800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.404312 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.464286 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4082f-eb5f-4739-92d8-be06f16da430 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.507907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.508580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.508862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.509144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.521815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.523413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-9482218c-de8a-4e54-b9c4-0d631069053a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:40.541377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:40.543254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:40.545039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:40.545039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:40.545039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:40.545039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 233/460] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:40.551094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.584818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.617748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc574-ffac-4f6f-8467-ffa55024a4e6 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.618314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc574-ffac-4f6f-8467-ffa55024a4e6 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.619084 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542dc574-ffac-4f6f-8467-ffa55024a4e6 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.621187 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 234/461] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:40.627360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.628004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.628463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.649993 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:40.651772 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.696967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3639b-ff45-4c10-9818-d60a0353defb None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.739025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 235/462] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:40.741168 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.746860 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.747505 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.747777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.748229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.749115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:40.749583 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.751162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.778805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 228/463] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:40.785980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.803424 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.931160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.936311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a11a66-8019-4807-8e26-67fe7a04b7ec None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.960502 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7714a617-c63e-4166-80f4-8d112d1aabce None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.007438 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.008059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.008326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.008779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.009589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.010635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.011603 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.012185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.012784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.013435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.035730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.041803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:41.066783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:41.067856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:41.068825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:41.068825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:41.068825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:41.068825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 236/464] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:41.078177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.150420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 229/465] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/users => generated 248 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:41.151702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.277849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.297283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848e166-725b-4e15-908c-8a087e3655b2 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.358228 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.358860 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.359257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.359384 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.360078 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:41.360484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.363243 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b129a0-5b0d-4600-931e-5567369892d8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.384466 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9fdd30-31b6-43ac-a80b-c02490e7913e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.390539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 237/466] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:41.392332 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590f2d-b8b3-4da2-ab5e-b6376e4dc46a None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.392851 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590f2d-b8b3-4da2-ab5e-b6376e4dc46a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.393483 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590f2d-b8b3-4da2-ab5e-b6376e4dc46a None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.395157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 238/467] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:41.401281 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e590f2d-b8b3-4da2-ab5e-b6376e4dc46a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.451764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.452713 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.453156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.453728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.460417 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.478855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.482072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-f37c19a8-a42e-4d2a-a0de-b910af03dd75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:41.515124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:41.516834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 230/468] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.527117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.560602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.561964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.577427 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e590f2d-b8b3-4da2-ab5e-b6376e4dc46a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.640619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.641679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.642162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.642622 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.644346 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.647206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.681272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 231/469] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:41.692687 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.760724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 239/470] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/users => generated 246 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:41.829840 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cf934f-472a-4d31-be06-cd4720966b06 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.852762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.876488 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.877136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.877487 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.877837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.878636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:41.879081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.880805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.897326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 232/471] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:41.907234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.914559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.078967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b15b72-b949-4678-b4c7-26a5e32f77ef None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.155373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.156668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.157193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.157710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.158647 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.160541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.237371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.327295 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 240/472] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/users => generated 248 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:42.392217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eda3b-78c5-4386-98de-f4ff41e150fd None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.437454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.438177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.438535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.438887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.454176 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.456621 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:42.477328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:42.479329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:42.482869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:42.482869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:42.482869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:42.482869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 233/473] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:42.495265 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.620298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.700590 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d887b68-1bd3-40f7-a72f-bef49af5ac34 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.750795 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.752180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.753407 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.754133 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.760261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:42.760261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.760261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083310-a8aa-4bf3-9d0e-72b1a1239f66 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.778065 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 241/474] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:42.787655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.856332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.979037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076e67e-12a7-4310-8bde-c254a16dba31 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.021240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.021899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.022239 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.022501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.023237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.024789 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef3e21-4cd1-4f1a-9aa3-d962ae9ba9e3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.146121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 234/475] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:42 2022] POST /identity/v3/users => generated 249 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:44.820606 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614617-f7d5-4580-a2d7-120011471116 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.821106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614617-f7d5-4580-a2d7-120011471116 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.821582 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80614617-f7d5-4580-a2d7-120011471116 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.824761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 242/476] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:44.834643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd4d5-320c-49ed-9bfa-eb2870e41aa9 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.835171 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd4d5-320c-49ed-9bfa-eb2870e41aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.835599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7bd4d5-320c-49ed-9bfa-eb2870e41aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.868085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-3f7bd4d5-320c-49ed-9bfa-eb2870e41aa9 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:44.870138 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-3f7bd4d5-320c-49ed-9bfa-eb2870e41aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.017800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 235/477] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:45.073017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a806f98-f857-469b-8488-3bf2a7d00333 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.073192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a806f98-f857-469b-8488-3bf2a7d00333 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.073469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a806f98-f857-469b-8488-3bf2a7d00333 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.075399 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 243/478] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:45.083231 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9146e-a85a-4655-a8e0-9383a1cf7de3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.087702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9146e-a85a-4655-a8e0-9383a1cf7de3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.087702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9146e-a85a-4655-a8e0-9383a1cf7de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.117159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-90c9146e-a85a-4655-a8e0-9383a1cf7de3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:45.119199 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-90c9146e-a85a-4655-a8e0-9383a1cf7de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.138598 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:45.252511 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 236/479] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:45.278482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af9e8-e41b-4149-a24d-e074ae9e8e53 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.278900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af9e8-e41b-4149-a24d-e074ae9e8e53 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.279310 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af9e8-e41b-4149-a24d-e074ae9e8e53 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.282342 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 244/480] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:45.290873 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.291347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.291803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.322404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:45.324521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:45.457670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 237/481] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:45.529048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af9e8-e41b-4149-a24d-e074ae9e8e53 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.610068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.686774 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af9e8-e41b-4149-a24d-e074ae9e8e53 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.708941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:45.738636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.740225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.740501 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.740855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.758000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:45.762999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:45.771188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:45.772026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 245/482] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:45.775833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.782258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:45.822483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7fc14-69fb-4f1f-81c8-807a4b393eca None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:45.894766 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:45.895961 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:45.896446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:45.896988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:45.918637 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:45.929203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:45.930337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:45.931154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:45.935077 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 238/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:45.935077 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:45.979970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617f783-dc98-4617-a1b2-79fd4aedb1f7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.052574 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.053597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.055154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.055154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.055831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.056372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.058986 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.075041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 246/484] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.075947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.130648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bd124-74ca-4360-966e-9ea82b55f850 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.130972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.185359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.186151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.186493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.186824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.189450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.201598 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:46.207105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45099fa0-8088-4edc-b68e-26a25f5a5994 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:46.207663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:46.208565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:46.209378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 239/485] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:46.210576 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.249988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.250739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.251003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.251282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.251958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.252269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.254268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544ce03-684d-4e29-9eda-19dc9073f5b5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.263886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 247/486] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.264976 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f694f9-7ef3-4dda-9c88-de0c98c7d9df None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.265258 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f694f9-7ef3-4dda-9c88-de0c98c7d9df None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.265529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f694f9-7ef3-4dda-9c88-de0c98c7d9df None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.267090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 248/487] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:46.267702 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f694f9-7ef3-4dda-9c88-de0c98c7d9df None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.332822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc8ac23-8f65-4a94-b8e7-01ec1f6a50d5 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.373009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.374152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.374665 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.375177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.389082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.389368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f694f9-7ef3-4dda-9c88-de0c98c7d9df None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.390689 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.392191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:46.407490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:46.408527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:46.410022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:46.410022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.410022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:46.410022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 240/488] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:46.410022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.456296 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.457385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.457998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.458568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.460052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.460354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.463206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9721009-5c2a-48eb-89a5-80fa76934d57 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.476544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.480357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 249/489] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.482626 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.483104 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.483573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.511219 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.512587 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.550052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db7613-0348-4a90-81aa-7537f1fcde38 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.589239 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.589915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.590199 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.590488 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.605043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.606813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.610003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 250/490] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:46.611298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:46.623562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:46.625397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:46.628409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:46.628409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.628409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:46.628409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 241/491] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:46.631607 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.781238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.785641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.789597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436691-1c6a-4e01-9272-8b9ee3195f3a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.793357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be97c2-f6f1-4f7a-b7e8-96213ac7f4ae None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.835194 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.835810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.836169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.836321 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.836984 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.837283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.838727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.861588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 251/492] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:46.861588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.864494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.865546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.866075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.866531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.879903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.881435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:46.900229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:46.902787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:46.904020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:46.904020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:46.904020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:46.904020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 242/493] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:46.904020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.007110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04eabe-403f-4c26-9306-f97cc0c21635 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.029557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7fab-064b-44a0-a239-f61a2fa8396b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.046700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.047224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.047502 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.047774 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.048426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.048726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.050226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.063353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 252/494] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.064371 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.079457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.080178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.080456 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.080780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.090082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.091579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:47.105075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.106734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 243/495] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:47.107973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.123189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.129114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.219770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684aff03-5a57-41d8-b364-403524c1c807 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.220052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09206d-b847-436e-9c82-003d1f73a126 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.255673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.255897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.256432 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.256533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.256799 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.256894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.257068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] PATH_INFO: `/v3/roles/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.257187 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.257976 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.258429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.260155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.268893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:47.274127 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 253/496] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.274884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:47.275113 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.276763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 244/497] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:47.278343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.367932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.372595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.408156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687475eb-82e0-46d7-b04d-ed998e0f1ce4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.418291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc8fdc3-5c71-4806-a48f-e58d110dd5be None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.448288 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.448922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.449216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.449486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.458096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.458437 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.459221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.459497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.459625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.459790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.460492 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.461906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.462718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:47.478293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.479656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:47.480596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 254/498] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:47.481196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.506253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 245/499] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.507391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.605767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224e97d-3d0b-46c3-b611-d33e3a33a1c5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.628560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4ebaa-0c00-481b-a228-8ddad0c9944b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.651537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.652182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.652457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.652725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.654973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.661906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.668824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.668961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.671379 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.671990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.672267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.672638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.673316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.673636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.675546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:47.676113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.677264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 255/500] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:47.678679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.690062 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 246/501] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.691548 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.819354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610870a-7077-4c60-b184-bc717b7f9618 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.853053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafa45c7-feea-462d-ade8-c1da4c46eaeb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.868060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.868706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.868989 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.869275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.903635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.904388 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.904765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.905170 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.906296 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.907032 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.909794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.950075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.960603 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.965815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.972848 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 256/502] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.974320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.041987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.080061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 247/503] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:48.081106 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.092077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a88efd-fd36-43d6-8fc8-78a43ca60a86 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.132531 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.133148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.133428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.133737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.134481 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:48.134786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.136331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.155822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 257/504] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:48.157658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.184802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.195549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd450bf-de2a-4d7c-a02d-74ac125da09e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.234888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.235868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.236145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.236417 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.247547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.249011 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:48.264232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:48.265200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:48.266175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:48.266175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:48.266175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:48.266175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 248/505] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:48.266175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.291096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d43149-e061-42a0-85ff-0ce8175ff199 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.302810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.327791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.331469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.331469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.331469 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.371966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d736d8-0834-4e4d-a40d-fb5371c0aad7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.408404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.409841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.425218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.426042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.426431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.426862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.439702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.441847 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.444036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:48.458773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:48.465557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:48.467131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:48.467131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:48.467131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:48.467131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 249/506] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:48.467131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.537930 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 258/507] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:48.538811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.552611 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.595865 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95afb-d0b2-4114-8535-1d1f382b75c6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.634109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.634955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.635347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.635808 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.650171 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63d20a-002b-4efb-a69d-5c04da3477c7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.686737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.687338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.687613 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.687878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.688523 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:48.688821 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.690772 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.703155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 259/508] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:48.704110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.735856 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.743856 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.745333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.792645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.835850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b238-b01e-4c09-91f8-61ef5d3ca9f5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.862805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 250/509] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:48.863675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.882531 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.883144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.883431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.883707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.884359 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:48.884663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.886208 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.901240 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 260/510] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:48.902386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.966088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:48.973883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db91d30-ed73-4607-b083-8876f691d65c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.008479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.009103 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.010876 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.010876 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.020651 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.022157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.026732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a050-225e-4922-8db4-2676ca921979 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:49.038043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.040238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:49.042236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:49.042236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:49.042236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:49.044140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 251/511] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:49.045122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.064007 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.069086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.069862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.070210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.070597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.078388 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.079949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:49.095918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.097726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 261/512] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:49.098999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.175094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf326da-4e55-49c2-bc70-ac14db39e7cb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.217467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.218056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.218341 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.218615 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.228004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c336a8a-694c-4fdf-b100-02d0744c1cb7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.233294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.234851 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.242713 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:49.254227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.263227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:49.264485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:49.264485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:49.264485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:49.264485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 252/513] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:49.264485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.272659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.273347 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.273649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.273922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.281427 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.283211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:49.304305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.305561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:49.306542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 262/514] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:49.308056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.377061 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.394346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeec3f61-8423-4fbf-bf85-cc5f855605bb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.430296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.430898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.431170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.431439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.432116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.432410 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.433821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.439648 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0081c-d96a-4298-8e52-9ad0eaa0d01c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.448062 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 253/515] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.448995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.484135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.484657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.484935 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.485210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.485978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.486281 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.487789 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.507300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 263/516] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.508169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.532408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.576793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9d62f-8988-47b4-b64f-9ab78ccfd35b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.619155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb797e7-a7c8-4b8c-9404-904df7cec9c7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.626336 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.627044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.627386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.627734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.628764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.629172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.630868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.630996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.647046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 254/517] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.647898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.666519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.667216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.667602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.667892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.668784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:49.669148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.671192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.695508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 264/518] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:49.696584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.791739 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590786b-10e8-4f84-bc92-3195eea4849c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.813679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.819502 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccac933-2b68-4abe-9c28-4aefc121c6da None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.844998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.846109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.846596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.847092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.857155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.858674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.865691 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.866635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.867137 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.867581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:49.872037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.873072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 255/519] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:49.874833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.911143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.948123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.949970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.019690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fa5e7-d921-4b77-9059-7d13dbf260a8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.059055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.059747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.060112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.060518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.064593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 265/520] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:50.065899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.068922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.070909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:50.083088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:50.086617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 256/521] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:50.088265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.144187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.156230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.197695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b7123-6d01-4282-98e3-c320c405cc2f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.236329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55737fd1-84ac-46d0-abad-d518d8bed3bc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.238595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.239210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.239532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.239768 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.240491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=e6c53c1c9519490f854adc67392e28d5) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.240831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.242285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.249342 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 266/522] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/role_assignments?user.id=e6c53c1c9519490f854adc67392e28d5&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.252883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.282895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.283532 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.284365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.284646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.285709 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.285709 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.287327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.309439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 257/523] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.310421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.418167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be0649-e1f7-4d0f-bc14-3f0d723bca05 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.466825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.478284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.478589 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.478877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.479161 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.491226 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.495899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.497886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cb0e9-bd3e-4198-9884-945566f63c08 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.498878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:50.524635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:50.526510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:50.528826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:50.528826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:50.528826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:50.530693 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 267/524] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:50.531436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.564976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.565965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.566418 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.566894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.568154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.568998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.571461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.597602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 258/525] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.599597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.696010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c33f6-727f-4a88-93b8-4204356dae6a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.749882 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1276eb-12a9-4d8c-bb1c-e5d26f47a073 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.762583 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.764043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.764454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.764854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.766042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=67de97570521456da7cea34e7994dbef) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.766436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.769222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.779952 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 268/526] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/role_assignments?user.id=67de97570521456da7cea34e7994dbef&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.780722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.826845 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.829060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.830755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.830755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.832516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.832935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.835803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.860891 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 259/527] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.866668 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.914265 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.921895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.998880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a26a-60f2-4222-9429-d3075b23476f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.074607 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.075610 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.075610 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.075971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.076828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=68e13037790741e081d38311378ddbdc) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:51.077048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.078565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.086765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 269/528] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/role_assignments?user.id=68e13037790741e081d38311378ddbdc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 259 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:51.132427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4e63e-8783-4c32-8f0f-c9891f61c7f4 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.198094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.199101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.199527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.199943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.210675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.212561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:51.229339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:51.230563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:51.232052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:51.234858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 260/529] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:51.241009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.397593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb2749e-a33a-417e-89e8-cb3eabbdc883 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.418592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.446666 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.447369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.447696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.447972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.449079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:51.449629 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.451536 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eefd8-4739-4a1e-8711-44ef42c3119e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.479673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 270/530] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:51.491226 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.653975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.705281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e977b-4e20-474a-81f4-da43bd240118 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.755937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.756565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.756841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.757114 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.757962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=7c02350215a147e7aeeeae512c99a7dc) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:51.758276 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.759922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5310652b-1879-4f23-aaea-619851b27c6f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.767062 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 261/531] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/role_assignments?user.id=7c02350215a147e7aeeeae512c99a7dc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:52.691642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38b8d-2c77-4233-99e9-20405de678fb None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.692236 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38b8d-2c77-4233-99e9-20405de678fb None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.692236 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a38b8d-2c77-4233-99e9-20405de678fb None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.694034 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 271/532] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:52.700050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.700592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.700592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.721177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:52.722933 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:52.804686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 262/533] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:53.142185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38b8d-2c77-4233-99e9-20405de678fb None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.288681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a38b8d-2c77-4233-99e9-20405de678fb None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.341891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.343184 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.343856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.344430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.359606 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:53.365122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:53.366151 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:53.366949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:53.369832 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 272/534] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:53.378087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.476161 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.513909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd0c8c5-ea4c-46a2-a566-4a1cdda7fc77 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.555277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.555904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.556212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.556449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.557136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:53.557457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.559026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.573684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 263/535] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:53.575389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.612771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.704914 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b21a9-dc2a-46f9-8fb3-85070f1a8f8e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.755527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.756783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.757362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.757903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.772300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.774546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4e563b9b-dec9-40f4-9de0-7d33aa46a74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:53.793494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:53.794505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:53.795380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:53.795380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:53.795380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:53.797635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 273/536] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:53.807694 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.928964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7231c0-7d81-4415-af7c-28fc3fa718dd None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.929601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7231c0-7d81-4415-af7c-28fc3fa718dd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.930113 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7231c0-7d81-4415-af7c-28fc3fa718dd None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.932022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 274/537] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:53.938685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.939335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.939921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.962601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:53.964580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.016059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df0d3a-4ae3-4619-9d56-bafb0840bfa0 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.093988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 275/538] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:54.107875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.108909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.109404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.109949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.111101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:54.111612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.118595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.121710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.145106 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 264/539] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:54.154841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.185959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.294665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c392af3-3801-486d-bfa3-886d36feeed1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.341505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.342714 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.343226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.343788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.352429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.354305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-6582e4ee-a9d8-4f28-be60-53994ea923fa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:54.368454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:54.369456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:54.370404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:54.373165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 276/540] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:54.383102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.503254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f812-87a9-48f1-9ffb-809d9da50f2e None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.503781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f812-87a9-48f1-9ffb-809d9da50f2e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.504249 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f812-87a9-48f1-9ffb-809d9da50f2e None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.513513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 277/541] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:54.516521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.517024 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.517515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.555385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:54.557593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.601473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d557bd87-54db-4f31-91ba-2642984fa837 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.661279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.662967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.663447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.663941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.665448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:54.666025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.668867 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.681873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 278/542] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:54.687079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.699262 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.709820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 265/543] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:54.718917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.841081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.908806 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3a7b4-9644-41c9-a7a5-9994fd820960 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.947217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd316847-20f5-4faa-b551-d945a45dc856 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.956883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.957887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.958166 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.958800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.975025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4c86462f-2746-45f0-8c8c-423868897618 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:54.979887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:54.981282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:54.982430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:54.986040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 279/544] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:54.987457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133509e-7ec6-4819-9a86-52886f670c33 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.987741 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133509e-7ec6-4819-9a86-52886f670c33 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.988018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133509e-7ec6-4819-9a86-52886f670c33 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.989331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 280/545] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:54.990659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133509e-7ec6-4819-9a86-52886f670c33 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.999616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.000262 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.001075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.001327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.018001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.020295 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-00de93ce-67e1-4eb5-9d7c-198e2be33d0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:55.039170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.040159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:55.041055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:55.041055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.041055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:55.041055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 266/546] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.042951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.043340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.043616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.062530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.064033 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.071983 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.116569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133509e-7ec6-4819-9a86-52886f670c33 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.146931 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 267/547] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:55.147795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.173739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.174800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.175286 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.175760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.177007 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.177839 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.180207 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.197028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 281/548] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.198598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.209526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.310060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d605b-4238-438f-ae03-ed0d72d1b080 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.378287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ade067-032a-4721-a58b-1c7148183bb5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.378879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.379849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.380290 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.380740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.401536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:55.411288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.412361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:55.413181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:55.414573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 268/549] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.414831 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.420544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.430847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.431478 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.431752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.432040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.432700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.433006 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.434463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.463885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 282/550] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.465335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.574136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.582007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19cf9e2-7099-45d2-877d-28b155c19a1b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.619848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.620498 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.620777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.621046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.636369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114d8a-95d0-4815-9ce8-08c20360577b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.638876 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.641689 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:55.669667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.671363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:55.673409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:55.673409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.673409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:55.673409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 269/551] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.673409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.680663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.681429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.681821 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.682173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.683041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.683404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.685515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.695614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 283/552] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.696731 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.764003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.814431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f97468-79e3-49d1-9724-883329b2bc22 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.823106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e95222-015b-4411-ad0d-bccaad697d1e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.863128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.863854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.864145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.864411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.866414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.867509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.868021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.868659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.872695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.874238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:55.887616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.888716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:55.889657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 270/553] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.890169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:55.890244 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:55.898927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.899978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:55.900829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:55.901555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 284/554] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.902311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.904988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.029348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0368805-ecba-404c-8a4d-b18f7fa17c1b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.040044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54128-f82c-4ea4-8773-cce310e39ef0 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.041367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.085338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.086678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.087160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.087615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.103973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.105046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.105572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.106158 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.106372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.107432 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.107961 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.109005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.110593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.132893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 271/555] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.134294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:56.135625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:56.136535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:56.137431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:56.137431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:56.137431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:56.138121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 285/556] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:56.139607 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.214433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.268246 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245c1c1-3b03-4819-9d78-a87a637b492a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.283266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1015780-98bd-43d7-a815-86fd9a977f65 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.310533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.311150 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.311430 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.311704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.312438 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.312743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.314317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.328213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 272/557] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.328520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.328899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.329174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.329445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.329600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.330167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.330473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.332035 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.341697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 286/558] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.342639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.376041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.466436 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47cc171-8560-40b2-a745-fa7ba59bc6d7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.477542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bf3b6-3641-4a29-88f9-974f36998ed2 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.501469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.513272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.514553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.515050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.515547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.522294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.523053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.523436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.523816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.524589 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.525014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.526613 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.531124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.534640 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.542641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 287/559] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.542641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:56.558332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:56.559527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:56.560690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 273/560] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:56.562179 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.648834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.673511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1ffdf-d594-4f65-93c9-c77bfedfb3a6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.735827 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.736850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.737404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.737731 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/e6c53c1c9519490f854adc67392e28d5/roles/5eff9a0ee07f41a19ce8ae91fc16a086` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.744974 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0a12a-eb28-42ec-b8e0-aeb49f01f682 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.764003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=e6c53c1c9519490f854adc67392e28d5, role_id=5eff9a0ee07f41a19ce8ae91fc16a086)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.766812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.801199 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.802103 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.802473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.802849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.814672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.816704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:56.837895 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:56.839123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:56.840280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:56.840280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:56.840280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:56.840502 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 274/561] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:56.842045 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.904794 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.921289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 288/562] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:56 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/e6c53c1c9519490f854adc67392e28d5/roles/5eff9a0ee07f41a19ce8ae91fc16a086 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:56.922038 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.009560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd296ed5-2064-4146-b8a3-e2c52cebcf7e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.057328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.058319 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.058598 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.058871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.071134 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.073364 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.083996 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ccf9a-64ea-41cb-8a34-b587f6dea061 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:57.087211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:57.094503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 275/563] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:57.095479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.149031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.156707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.157976 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.158219 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.161749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.161749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:57.161749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.167057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.194922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 289/564] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:57.196556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.216665 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.225268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60618a49-4322-4884-bb4b-b69fa6fa5963 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.263896 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.264775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.265192 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.265590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.266292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:57.266728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.268856 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.285988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 276/565] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:57.287154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.335149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01aaa5-00b8-4778-b895-caaf2cb48182 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.394122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.395192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.395888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.396344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.397284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:57.397803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.399460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.423257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 290/566] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:57.424361 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.481336 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cda939-919d-43f9-8b7e-f9b02207111f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.490034 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.540127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.541255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.541785 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.542250 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.568672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.571300 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.576023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69c4fc-3872-4938-8ba5-22a544adc77b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:57.596447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:57.598182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:57.601056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:57.601056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:57.601056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:57.604331 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 277/567] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:57.604790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.620775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.641077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.641753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.642033 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.642316 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.660351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.661960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:57.678292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:57.679753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:57.681162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:57.684266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 291/568] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:57.685269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.772220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b36b5b-949e-4767-9f31-c63b85d5bab6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.814060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.816224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.816504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.817100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.828680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3e60-77be-4fdd-acbc-ea3d8b8c8c4a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.830549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.832618 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.842048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:57.851257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:57.852710 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:57.854556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:57.854556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:57.854556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:57.854556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 278/569] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:57.855202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.876005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.876818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.877172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.877507 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.879887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:57.880205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.881730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.899576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 292/570] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:57.901548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:57.973683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.046580 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7801c-f85a-4ca4-a560-922de6bf4fcb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.080175 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272e7e48-e903-4552-9776-8ad6ef40dbe7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.102087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.102668 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.102942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.120797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.120797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:58.120797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.120797 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.132412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 279/571] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.132412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.136925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.137752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.138072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.138356 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.139363 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:58.140203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.141528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.165401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 293/572] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.165401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.206021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.308817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed62e24-e802-42b4-87d0-bc91517335fc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.319551 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5500-8cd0-4021-8cd4-9784fb5757b0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.358681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.367902 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.368855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.369381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.369816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.385292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.386515 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.387103 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.387218 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.387717 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.389533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.401349 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.404292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:58.415903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:58.417116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:58.418190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:58.418190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:58.418190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:58.422013 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 294/573] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:58.423257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:58.425659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:58.426723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:58.427824 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:53:58.430802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 280/574] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:58.431840 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.536557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.555957 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b244c54-8217-4030-8a9d-9a9c446583f7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.562812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a7007-a8c6-40f9-97bb-9d9dbbb7493d None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.595484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.596316 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.596714 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.597073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.601828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.602604 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.603027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.603442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.604252 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:58.604396 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.604827 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.605888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.606665 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:58.617367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:58.618499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 295/575] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:58.619411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.626054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 281/576] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.627065 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.676693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.742809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b608-79e8-44a0-b58c-62af2476f602 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.757239 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d60b9-fa39-49bd-bb7d-61be8f21f85b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.785720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.786960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.787550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.788146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.789553 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:58.790200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.793041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.804260 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.804976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.805323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.805688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.806471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:58.806850 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.808390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.810928 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.822822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 296/577] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.822822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.827535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 282/578] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.832643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.960854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f48e797-017e-4103-b926-625e7142ab87 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.966732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.972406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987fdfd0-335e-4602-9f31-0ff9af381d68 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.999740 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.000374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.000766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.001052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.012447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.014642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.021509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.022925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.023383 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.023831 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/68e13037790741e081d38311378ddbdc/roles/5eff9a0ee07f41a19ce8ae91fc16a086` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:59.027669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:59.028619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:53:59.029512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 297/579] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:59.030572 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.046481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=68e13037790741e081d38311378ddbdc, role_id=5eff9a0ee07f41a19ce8ae91fc16a086)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.048365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.099582 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.144435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669a3e8-5b44-44e0-87c4-3fbe33178a3b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.185682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.186368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.186649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.186927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/67de97570521456da7cea34e7994dbef/roles/5eff9a0ee07f41a19ce8ae91fc16a086` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.205052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=67de97570521456da7cea34e7994dbef, role_id=5eff9a0ee07f41a19ce8ae91fc16a086)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.207154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08b8ec-d102-481a-868a-d57a080f05a9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.280838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 283/580] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:58 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/68e13037790741e081d38311378ddbdc/roles/5eff9a0ee07f41a19ce8ae91fc16a086 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:59.280838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.376521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 298/581] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:59 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/67de97570521456da7cea34e7994dbef/roles/5eff9a0ee07f41a19ce8ae91fc16a086 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:59.378573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e589-0317-4897-9c24-b53ac8f3e90c None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.379005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e589-0317-4897-9c24-b53ac8f3e90c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.379430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b8e589-0317-4897-9c24-b53ac8f3e90c None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.381738 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 299/582] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:59.389530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.389836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.390108 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.413571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a559279-7ecd-47eb-bebb-ed3b6179f1e2 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.437389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:59.440486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.479332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.480903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.481302 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.481726 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.483131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.483612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.486084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.508172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 284/583] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:59.514083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.530054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.566014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 300/584] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:59.700781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604abee4-ac97-4dd0-bbc1-50324cb5a8a1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.745539 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.746251 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.746530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.746804 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/7c02350215a147e7aeeeae512c99a7dc/roles/5eff9a0ee07f41a19ce8ae91fc16a086` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.764143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=7c02350215a147e7aeeeae512c99a7dc, role_id=5eff9a0ee07f41a19ce8ae91fc16a086)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.765740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.848088 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 285/585] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:59 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/7c02350215a147e7aeeeae512c99a7dc/roles/5eff9a0ee07f41a19ce8ae91fc16a086 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:53:59.921028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.972146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.052144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4e3162-0928-48ef-aaab-c2828ec40ddd None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.097486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.098281 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.098501 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.098797 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.112350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:00.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:00.118437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:00.119313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 301/586] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:00.126813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.207858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.282896 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dedd39-0766-4bc5-89f2-fa00447c354d None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.339458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.340474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.340971 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.341464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.342835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:00.343440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.346165 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.364255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 286/587] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:00.370827 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.500146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.503385 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d2d22-03bc-49e5-b2a0-f4174aa74953 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.544252 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.545076 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.545371 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.545656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.557655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.559289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:00.578196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:00.587276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:00.588212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:00.588212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:00.588212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:00.588212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 302/588] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:00.588443 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.748149 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3bfec-2537-4c8f-9bf1-2618441a8917 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.787481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.810458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.811601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.812099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.812579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.813910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:00.814459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.817699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.843465 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 287/589] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:00.848938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.964952 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483f28f-df93-477e-865c-65f52b9c8df1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.005025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.005587 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.005896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.006169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.015086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.016755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:01.029466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:01.031813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:54:01.034547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:01.037672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 303/590] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:01.038218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.242535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f0180-0a61-4b14-b703-309e569f51db None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.315073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.316109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.316778 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.317357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.318855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:01.319395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.322099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.358768 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 288/591] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:54:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:01.365117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.383402 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:01.479638 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd20be-10f6-40f5-8d5e-87c2a622a8d7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.517706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.518334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.518641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.518920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.606717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.608178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20bafc-a4d7-443c-becf-0d0870f3ce2b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.626271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:01.732386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 304/592] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:01.734481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:01.774408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cabe1-9e6d-4419-8ca1-6152254cbc34 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.774746 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cabe1-9e6d-4419-8ca1-6152254cbc34 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.774958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9cabe1-9e6d-4419-8ca1-6152254cbc34 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.776955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 305/593] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:01.787029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:01.789468 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.789779 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.790058 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.812132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:01.813428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:01.865929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844a97db-42be-4284-91de-b73ff0abbe9e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:01.902477 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 306/594] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:01.921396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:01.922513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:01.922986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:01.923298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:01.943407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:01.946004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:01.974914 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:01.976204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:01.977126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:01.977126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:01.977126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:01.981877 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 289/595] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:01.988106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.065455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.160616 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c5f4f-0ac2-4ce6-8c1a-6755a40b7d2a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.212023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.212640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.212916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.213185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.213871 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:02.214172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.215540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.233506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 307/596] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:02.234924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.249523 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.376674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb12b2e5-2524-4386-a1a6-831757773f58 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.378637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.393986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.411403 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c5b0-2afa-4a75-bfa0-0ec97e3972eb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.418049 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.421043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.421043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.421043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.433176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:02.438317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:02.440513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:02.442512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:02.444968 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 308/597] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:02.450845 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.478609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.480350 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.480927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.481394 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.490672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.492537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:02.507738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:02.508721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:02.509650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:02.512479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 290/598] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:02.519842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.585787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad069e4-324c-4498-b67c-75ef7ee96da3 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.635549 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.637036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.637524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.638167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.639392 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:02.639947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.642684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e56064-3d14-4509-b76a-0ca1e691738b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.646766 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a4517-1ceb-47c1-a8fa-8ff90134044e None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.659311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 309/599] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:02.662215 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f41f-8c3a-4d50-8821-f425945c864b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.662637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f41f-8c3a-4d50-8821-f425945c864b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.663120 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118f41f-8c3a-4d50-8821-f425945c864b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.665882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 310/600] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:02.674662 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48489-4e8d-44c7-9ecd-858776b6fdea None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.675170 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48489-4e8d-44c7-9ecd-858776b6fdea None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.675668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48489-4e8d-44c7-9ecd-858776b6fdea None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.682472 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 311/601] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:02.682472 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48489-4e8d-44c7-9ecd-858776b6fdea None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.691051 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.691804 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.692185 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.692544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.693414 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:02.693853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.695473 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582c1a8-c525-42b5-82e1-cfee83dfca6e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.709051 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 291/602] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:02.710356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ac9e-c08d-494d-8ef6-b9ada6b0e292 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.710520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.710663 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ac9e-c08d-494d-8ef6-b9ada6b0e292 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.710938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ac9e-c08d-494d-8ef6-b9ada6b0e292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.730700 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-6758ac9e-c08d-494d-8ef6-b9ada6b0e292 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.731986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-6758ac9e-c08d-494d-8ef6-b9ada6b0e292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.740356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.804805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 292/603] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:02.806392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.806565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48489-4e8d-44c7-9ecd-858776b6fdea None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.806665 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.806929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.835966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.837222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.851216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.851966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.852246 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.852517 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.868431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.871401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:02.891652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:02.902568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:02.903503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:02.903503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:02.903503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:02.903503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 312/604] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:02.903503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.922652 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 293/605] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:02.923863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.043380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.079976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.094656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12acf976-4f7f-4fa5-b54b-47042cca78c4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.133713 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccac80b2-8a9e-483b-be8b-52452c7ae38f None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.162304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.163285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.163768 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.164278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.165087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=e6c53c1c9519490f854adc67392e28d5) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.165497 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.167002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.173239 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 313/606] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/role_assignments?user.id=e6c53c1c9519490f854adc67392e28d5&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 608 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.179806 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.180438 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.180712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.180982 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.182283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.182596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.182814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.184090 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.205387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 294/607] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.207040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.359841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa75008-c48d-4c6e-8189-258bb1f75be7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.360905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b11df5-a1db-4fdd-b5b9-5ab14dd875a4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.419594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.425741 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.426528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.426688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.426885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.426885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.427137 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.427332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.427598 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.437075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.437271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.438598 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.442411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:03.447232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:03.448366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:03.449337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 314/608] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:03.450094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:03.462863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:03.464130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 295/609] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:03.465237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.591275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aec6eb-1757-499b-9330-56ec6e752ed0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.593007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef44fab-c69d-43f6-9cc7-9b1bf0ad95d3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.634591 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.635328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.635681 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.636057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.642040 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.642672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.642954 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.643229 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.644007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.644311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.645854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.648704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:03.654090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:03.660692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:54:03.661567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:03.662258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 296/610] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.662258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.662999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 315/611] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:03.663884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.738529 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.755854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.787756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1318199-41b7-4b61-a79c-5c5359b78d5b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.827142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a5b64-a4b6-4ea7-81ab-a6946a4352c4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.832205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.833130 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.833480 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.833875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.834846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.835254 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.837155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.857955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 297/612] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.858956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.876505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.906074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.906074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.906074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.906074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.906074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:03.912322 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:03.913267 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:03.915020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:03.915020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:03.915020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:03.915020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 316/613] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:03.915020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.979359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc20fcea-1b55-4e1f-ae5e-a00fdd36ea4c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.999089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.022155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.031907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.033941 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde752bd-30e9-4b2e-a1fb-b25a9a4d3347 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.042957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 298/614] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:04.042957 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.062659 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.087393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.100428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.100428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.100428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.158673 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb9ad7-9719-429c-8691-0fda821deebc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.172520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.174010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.206795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.207560 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.208295 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.208686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.209230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:04.212014 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.212014 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.224222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 299/615] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:04.224994 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.278308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.290559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 317/616] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:04.295951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.312237 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.341966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1863427-69e8-442f-9691-6e855f394b44 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.381195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.382102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.382379 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.382716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.393379 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.395804 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:04.414006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:04.415073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:04.415992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:04.415992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:04.415992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:04.416682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662c086-562c-4f78-846f-5936c761de26 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.419898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 300/617] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:04.420510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.466567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.467433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.467719 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.467995 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.476627 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.478126 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:04.490947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:04.492311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 318/618] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:04.493699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.552475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.578814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3cc9fc-3aea-4db4-8376-e4c8a3a03f15 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.582811 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.631748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.632397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.632677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.632951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.645022 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.646826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.649334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269d64-08d3-4b6d-8afc-b81bfe372e88 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:04.668203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:04.669484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:04.670585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:04.670585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:04.670585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:04.672050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 301/619] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:04.673139 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.698567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.699372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.699788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.700244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.701223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:04.701753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.703568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.725654 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 319/620] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:04.725654 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.806207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185cee3-a2ce-4318-baca-e0a8c2b54a02 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.843779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.844395 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.844674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.844943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.845704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:04.846008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.848294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.863384 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d2e1f-35de-42c4-b950-9513365cd484 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:04.867766 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.886926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 302/621] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:04.886926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:04.908478 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:04.925357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:04.926395 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:04.926819 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:04.927300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:04.928475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:04.929025 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:04.931866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:04.954756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 320/622] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:04.957008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.012933 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab78f94-e013-478a-81bf-45be0593cca1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.056497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.057430 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.057913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.058368 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.067911 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.069386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:05.083298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:05.084371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 303/623] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:05.085408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.096600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6f617-404b-487b-90b6-e30da15ae3e4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.142352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.143450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.144641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.145170 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.167814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.230100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc55c67-f38c-47ac-a3be-e46e6ead9714 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.231006 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.244116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.245598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.273477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310f421-3c23-4036-983f-17a784362467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.274434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310f421-3c23-4036-983f-17a784362467 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.274862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310f421-3c23-4036-983f-17a784362467 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.275256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310f421-3c23-4036-983f-17a784362467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.285096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310f421-3c23-4036-983f-17a784362467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.287845 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310f421-3c23-4036-983f-17a784362467 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-8310f421-3c23-4036-983f-17a784362467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:05.300853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:05.301965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 304/624] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:05.303513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310f421-3c23-4036-983f-17a784362467 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.371242 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 321/625] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:05.372309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.450677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310f421-3c23-4036-983f-17a784362467 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.480193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.505837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.506426 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.506944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.507403 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.508133 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:05.508478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.509936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.510683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.519579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e808def-4091-49db-8a3d-67bf92645d3a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.528119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 305/626] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:05.528954 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.556008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.556615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.556893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.557165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.557904 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:05.558209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.559650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62a1e3-9596-48fa-bb40-944f1c01fe26 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.580210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 322/627] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:05.581515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3495c-d145-4165-88ac-bad582ca8643 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.581831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3495c-d145-4165-88ac-bad582ca8643 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.582099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3495c-d145-4165-88ac-bad582ca8643 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.583362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 323/628] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:05.584086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3495c-d145-4165-88ac-bad582ca8643 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.672332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900432e0-6d8e-4637-b769-a698924f7d12 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.715255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3495c-d145-4165-88ac-bad582ca8643 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.717044 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.717722 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.719004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.719004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.730095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.731604 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:05.747653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:05.749594 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:05.751411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:05.751411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:05.751411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:05.751411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 306/629] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:05.751411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:05.766045 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.766634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.766906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.767408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.788085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.799802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.860144 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.861641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.892467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70de67-5530-41d3-874e-fb80b7f3e138 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:05.930546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:05.931072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.931391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.931581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.932365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=68e13037790741e081d38311378ddbdc) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:05.932701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:05.934222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f06594-05a2-43d6-ba1e-b4be62a8a08f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:05.941122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 307/630] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/role_assignments?user.id=68e13037790741e081d38311378ddbdc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:05.942426 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.942713 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.942998 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.962612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:05.963901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:06.011255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 324/631] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:06.011255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.085841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 308/632] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:06.085841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.111878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.133731 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.225045 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b27d6-969b-4020-8fc7-6a6168e7185b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.246901 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d91a4f-0c4f-4b68-ab5e-fadf68a2d08f None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.286333 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.286954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.287144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.287304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.287593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.287746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.288018 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.288177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:06.288309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.288434 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.290026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.300747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.302818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.312110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 325/633] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:06.318373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:06.323298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:06.324345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:06.325944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:06.325944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:06.325944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:06.325944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 309/634] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:06.330227 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.415061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.450476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce226b87-0d1a-474a-b807-ce5a8c85ddc7 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.474132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c4e2d1-1121-4bfe-aa61-690b0ba67f0a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.492077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.501499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.502471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.502913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.503330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.505575 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:06.505575 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.506505 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.517335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.519245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.519710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.520167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.521880 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 310/635] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:06.527499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.529518 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.531293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:06.544521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:06.545505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 326/636] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:06.546516 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.652970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dda40f-430f-4706-a846-a85594763fa6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.681676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755eacb3-546e-4ec3-b308-a23a3c633f69 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.686624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.693094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.693787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.694070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.698449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.702826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.705385 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:06.725496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:06.726915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:06.727905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 311/637] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:06.731593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.732268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.732689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.733173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.733712 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.734804 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.737434 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:06.758230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:06.760117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:06.762354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 327/638] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:06.765513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.824418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.898549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516b5c9-a305-444e-80e2-a3f19f757f83 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.918416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd1785e-f7e2-42ce-b6e9-794cb7fffa69 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.950854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.951456 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.951728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.952383 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.952712 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:06.953011 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.954510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.975078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 312/639] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:06.975078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.982313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.983369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.983864 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.984357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.985688 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:06.986225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.989085 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.013278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 328/640] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:07.013278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.046834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.120699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c91084-7745-478d-9f59-cd6f6221659a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.162384 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.163074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.163349 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.163623 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.164279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:07.164568 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.166021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.174245 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 313/641] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:07.177953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.181996 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.182979 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81bf92-5332-4bb3-9daa-a00534cd7aac None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.226570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.227173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.227502 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.227685 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.228439 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=67de97570521456da7cea34e7994dbef) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:07.228742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.230264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.237714 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 329/642] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:07 2022] GET /identity/v3/role_assignments?user.id=67de97570521456da7cea34e7994dbef&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:07.238311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:07.359585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af9cfa-11c6-4a49-a39e-1265b1b52296 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.368302 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555b098d-a67e-42ff-8f39-1736e2edd116 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:07.394367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:07.419577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.420722 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.421153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.422054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.422905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:07.423868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.425878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b549dd0b-aeeb-4a97-ae77-ff05fb167083 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.430609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:07.431684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:07.432436 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:07.432991 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:07.434255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 330/643] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:07.434761 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=7c02350215a147e7aeeeae512c99a7dc) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:07.435765 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:07.445646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3514c4-e926-459b-9146-f1259e07e195 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:07.455254 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 314/644] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:07 2022] GET /identity/v3/role_assignments?user.id=7c02350215a147e7aeeeae512c99a7dc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:08.406750 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd4c-de78-4e8f-98f8-3e631b5e854f None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.407344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd4c-de78-4e8f-98f8-3e631b5e854f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.407344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6cdd4c-de78-4e8f-98f8-3e631b5e854f None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.409725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 331/645] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:08.415874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.416474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.416474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.441638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:08.441638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.603372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 315/646] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:54:08.977368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdd4c-de78-4e8f-98f8-3e631b5e854f None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.006244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.100551 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6cdd4c-de78-4e8f-98f8-3e631b5e854f None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.143482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.144149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.144426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.144695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.156760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:09.162474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:09.163578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:09.164576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 332/647] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:09.170239 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.286392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de7cd4-c4cf-4c65-a796-6d9d18156942 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.298607 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.323699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.327499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.327499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.327499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.327499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:09.327499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.328169 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.338388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 316/648] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:09.347807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.486924 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.515190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604d6ade-e13b-4aff-be9c-e74f2c8de1b0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.577222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.577820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.578098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.578367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.591860 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.593364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:09.610849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:09.611903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:09.612857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:09.612857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:09.612857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:09.612857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 333/649] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:09.621635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.759652 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacf2bc-abf1-4cc1-8020-51c505cf332a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.802504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.803539 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.804053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.804561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.805476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:09.806073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.807749 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f87719-87da-4625-84f5-3dc556c03502 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.823959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 317/650] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:09.830929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.966635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719a5ba-66c8-4ec4-a3af-ad919d679cce None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.009847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.010490 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.010767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.011033 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.014473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.016550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00472e13-8186-4cb9-9469-80234e3f3395 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.017026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00472e13-8186-4cb9-9469-80234e3f3395 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.017306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00472e13-8186-4cb9-9469-80234e3f3395 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.019068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 318/651] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:10.028177 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.029884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa784b-0ed1-4d59-b2f4-f5edfd2f2817 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.030540 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa784b-0ed1-4d59-b2f4-f5edfd2f2817 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.031098 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aa784b-0ed1-4d59-b2f4-f5edfd2f2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.032520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-9b85c6c6-dd0d-400b-9f8a-ab7b7192ed7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:10.061339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:10.062938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:10.064880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 334/652] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:10.067343 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816359a-11ff-4882-b5ce-d4d8e376140a None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.067343 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816359a-11ff-4882-b5ce-d4d8e376140a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.067796 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816359a-11ff-4882-b5ce-d4d8e376140a None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.073105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 335/653] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:10.073105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816359a-11ff-4882-b5ce-d4d8e376140a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.077123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-09aa784b-0ed1-4d59-b2f4-f5edfd2f2817 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:10.077123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-09aa784b-0ed1-4d59-b2f4-f5edfd2f2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.109145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.159431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 319/654] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:54:10.160753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733dfe9-c951-4028-8456-3a9f731e5c19 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.161032 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733dfe9-c951-4028-8456-3a9f731e5c19 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.161307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733dfe9-c951-4028-8456-3a9f731e5c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.183965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-2733dfe9-c951-4028-8456-3a9f731e5c19 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:10.185170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-2733dfe9-c951-4028-8456-3a9f731e5c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.197813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816359a-11ff-4882-b5ce-d4d8e376140a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.239697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.240318 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.240592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.240864 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.241735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:10.242050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.243524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a6acf-a1a5-41e4-9f81-2de7e5fe13bb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.271734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 336/655] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:54:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:10.273196 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246611-034d-4ffb-ac21-915cc4b113f0 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.273637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246611-034d-4ffb-ac21-915cc4b113f0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.273918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246611-034d-4ffb-ac21-915cc4b113f0 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.275280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 337/656] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:10.276044 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246611-034d-4ffb-ac21-915cc4b113f0 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.279554 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 320/657] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:10.283422 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.284027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.285159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.307470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:10.309250 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:10.419987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.446903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 321/658] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:10.515735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246611-034d-4ffb-ac21-915cc4b113f0 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.556583 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.557435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.557909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.558364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.566151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.595068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.640958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.642466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.719008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce3c09-ca18-491c-a244-1e9ab1d22cd8 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.747759 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.764528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.765468 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.766075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.766335 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] PATH_INFO: `/v3/services/image` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.766933 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.768317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:10.780006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:10.781970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.783777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 322/659] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Aug 18 20:54:10 2022] GET /identity/v3/services/image => generated 86 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:10.785397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.824638 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 338/660] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:54:10.825512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.884697 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:10.901934 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a4c52-db18-485d-9094-a99767bf6ac3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.943680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f7910-52a2-466b-a685-ca4ca9249c49 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:10.945532 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.946522 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.946967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.947404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] PATH_INFO: `/v3/services/network` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.948115 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:10.950497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:10.965725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:10.966879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:10.967748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 323/661] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:10 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:10.969277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:10.996332 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:10.996954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:10.997233 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:10.997504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:10.998189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] RBAC: Adding query filter params (name=image) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:10.998501 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.000112 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.005676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 339/662] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:11.005676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.028916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.097246 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564046e-bf12-45fe-bf08-36646535ad2d None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.122632 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89324a6-fa9a-4b72-8ab0-dc664be5b5fb None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.142181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.143215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.144252 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.144747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.145971 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.148614 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.159785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.160421 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.160770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.160954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.172171 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.173832 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:11.189765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:11.191555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:11.192485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:11.192485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:11.192485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:11.192485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 340/663] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:11.192485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.276454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.288805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 324/664] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:10 2022] POST /identity/v3/services => generated 251 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:11.290072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.313103 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.318859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a61451-90b9-4487-bb96-f68411125a01 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.372265 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.372907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.373183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.373452 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.374156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] RBAC: Adding query filter params (name=network) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:11.374456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.375912 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.382401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 341/665] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:11.383289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.453622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c823b87-8031-45f4-b7e5-b605f1faf30c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.512885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.513507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.513817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.514085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.514822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] RBAC: Adding query filter params (type=image) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:11.515135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.516613 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.524070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 325/666] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/services?type=image => generated 122 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:11.524953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.535820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813e47d-2cef-4ce5-bd7e-38e9cc996b22 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.588684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.599862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.600783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.601205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.601715 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.602556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:11.603127 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.604959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.621106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 342/667] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:11.627216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.646922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:11.691029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f34292f-1466-4212-92d8-4c0247819a06 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.752155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.753648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.755304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.755581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.757250 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] RBAC: Adding query filter params (type=network) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:11.757696 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.761355 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.771815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 326/668] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:11.780579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5603af5-8fdc-45aa-8010-d4b8ec24b7f2 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:11.833354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:11.833944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.834211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.834486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.843129 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:11.844717 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:11.858808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:11.860571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:11.862445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 343/669] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:11.866536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:11.998666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a128fb-3c77-4404-abb5-0eb8686a96b3 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.042731 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.043585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.043868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.044189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.044915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:12.045219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.046906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cf5fc-b596-40d5-8b4a-47f006236b36 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.055407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.064263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 327/670] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:12.071966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.150991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.210090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fff29-aac0-49f6-8176-f0c3820d5d10 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.250917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.251535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.251831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.252112 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.252815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=827bfda051654edd9446aae79c093444, user.id=68e13037790741e081d38311378ddbdc) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:12.253724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.255289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d6831-03cb-4c9e-ae0d-dc7ef8b5d0d3 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.262241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 344/671] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/role_assignments?user.id=68e13037790741e081d38311378ddbdc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:13.968574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11d55-a26b-40a1-8abf-fb3983c36ed6 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.969403 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11d55-a26b-40a1-8abf-fb3983c36ed6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.969403 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f11d55-a26b-40a1-8abf-fb3983c36ed6 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:13.970830 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 328/672] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:13.980475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555da5-62df-4d48-8d79-5664c984f5d4 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:13.982044 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555da5-62df-4d48-8d79-5664c984f5d4 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:13.982832 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555da5-62df-4d48-8d79-5664c984f5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.015686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-9c555da5-62df-4d48-8d79-5664c984f5d4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:14.017501 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-9c555da5-62df-4d48-8d79-5664c984f5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.027925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197b73-abb6-4b82-a025-95837b771714 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.028316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197b73-abb6-4b82-a025-95837b771714 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.028475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29197b73-abb6-4b82-a025-95837b771714 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.030206 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 329/673] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:14.037084 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d0a0-b49c-463c-b31f-e1e0b489c48e None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.037388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d0a0-b49c-463c-b31f-e1e0b489c48e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.037733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df63d0a0-b49c-463c-b31f-e1e0b489c48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.058008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-df63d0a0-b49c-463c-b31f-e1e0b489c48e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:14.059248 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-df63d0a0-b49c-463c-b31f-e1e0b489c48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.162434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 330/674] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:14.176332 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 345/675] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:14.414025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a240ad-4455-4960-9fa0-2f3f9ac70cee None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.414392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a240ad-4455-4960-9fa0-2f3f9ac70cee None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.414582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a240ad-4455-4960-9fa0-2f3f9ac70cee None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.416257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 331/676] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:14.421991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.422287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.422542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.442822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:14.444042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.503863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:14.542097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 346/677] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:54:14.542557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a240ad-4455-4960-9fa0-2f3f9ac70cee None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.550932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.665108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a240ad-4455-4960-9fa0-2f3f9ac70cee None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:14.670672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b25bb0-98df-4001-a449-31c0b7b1ebc3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:14.697965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:14.707030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:14.707904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.708252 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.715618 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.715763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:14.715863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:14.715937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.715937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.715937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.716141 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:14.716220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:14.716220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-52b3cee3-d56d-441e-a521-2123a016ee7f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:14.720969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:14.722626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:14.723519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 332/678] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Aug 18 20:54:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:14.724325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d40be-37ef-4367-ac51-2f2ec47e3d6b None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.724325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d40be-37ef-4367-ac51-2f2ec47e3d6b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.724459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d40be-37ef-4367-ac51-2f2ec47e3d6b None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.726143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 333/679] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:14.731775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.732092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.732317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.753429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:14.754725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.813861 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 347/680] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/services => generated 242 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:14.814963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.854478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 334/681] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:54:14.864565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:14.890207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.959815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090d2778-2823-49b5-a8f7-b887d1e90b02 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.005179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.006613 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.007083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.007520 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.008554 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:15.009039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.010756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.016793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 348/682] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.020528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58062135-cc50-4515-8713-acc11c0045e3 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.023549 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.051012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.083675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.085484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.087012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.087505 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.088202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.089668 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.182798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.187977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2622cc6b-bf0c-42f2-a154-fce4504c5f4d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.225160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.225727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.226010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.226280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.226920 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:15.227222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.228610 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.234019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 349/683] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:15.234884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.253654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 335/684] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/services => generated 240 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:15.253654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.424080 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3690-623f-44d3-94da-5ec9db7ecc91 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.483122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2252a47-2438-4a11-be72-445a2fd20109 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.530447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.531546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.532063 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.532543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.534043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] RBAC: Adding query filter params (interface=public, service_id=f8b3742281d647108fc7587128c71c03, region_id=RegionOne) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:15.535163 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.537626 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.547437 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 336/685] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/endpoints?service_id=f8b3742281d647108fc7587128c71c03&interface=public®ion_id=RegionOne => generated 194 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.556596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.610332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.618343 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.619406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.619901 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.620390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.640401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:15.651238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:15.652292 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:15.653178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:15.661260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 350/686] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:15.663096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.692159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6cb50d-972d-4e7b-9b34-34858a2756fe None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.693738 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.734036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.735533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.735990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.736450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.737281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.738885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.745543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 337/687] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:15.863946 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b973d4-64fe-45d1-b631-3dfabafa9a3d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.938145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.939203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.939673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.940138 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.941954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:15.942483 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.945083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.962729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 351/688] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.970485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:16.101353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24050c-df5a-4634-a39a-0b95c7de5c61 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:16.103089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:16.169946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:16.171404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:16.172101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:16.172801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:16.195868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:16.199055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:16.219617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:16.220820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:16.221936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:16.221936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:16.221936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:16.228095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 338/689] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:16.229784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:16.366958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:16.379222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f5d1e2-403c-42b1-a6b9-cbdd1199ff37 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:16.436989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:16.438067 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:16.438546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:16.439020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:16.440195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:16.440724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:16.443319 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:16.468664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 352/690] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:16.473164 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:16.651906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced843f7-f4fa-496a-babd-adc9c3f106a1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:16.698989 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:16.699644 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:16.699922 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:16.700193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:16.710547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:16.712052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:16.725264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:16.726346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:16.727322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 339/691] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:54:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:16.735893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:16.930390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930040a-d172-4551-a642-aa8615749c6a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:16.992530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:16.993506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:16.994011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:16.994484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:16.995807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:16.996312 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:16.998916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.029886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 353/692] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:54:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:17.037041 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.057719 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.160019 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4e219-c561-41db-83c3-a91316c2d1f6 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.196225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.196779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.197058 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.197328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.209222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.210715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:17.226154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:17.227151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:17.228527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:17.228527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:17.228527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:17.228527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 340/693] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:17.234645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.240117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.353173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0cb916-293d-4cb3-ad44-2dd5481f7666 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.396412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.397024 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.397301 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.397573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.398268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:17.398569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.399972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96432735-b5f4-4550-8cbe-ec8618874256 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.414235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 354/694] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:17.422765 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.495286 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5188f-c142-41f1-90ca-0d8884c40685 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.496180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5188f-c142-41f1-90ca-0d8884c40685 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.496675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5188f-c142-41f1-90ca-0d8884c40685 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.499266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 355/695] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:17.504804 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.505002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.505207 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.505484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.528657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:17.530231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.551396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0304914-cb5e-405d-8981-bc6c54aa2a0b None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.602015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:17.606038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.606704 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.606984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.607257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.616359 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.618003 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.619618 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 356/696] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:17 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:17.640389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:17.641380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:17.642324 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 341/697] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:17.647973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.767423 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11229e25-c2ab-42c0-b7a0-bff23c4ebd31 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.806669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:17.807594 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.808081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.808533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.809412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:17.809924 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:17.811549 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:17.825140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 357/698] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:17.836885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:17.960685 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf571b1-a18d-4e00-9cf4-4b940243b66c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:17.980389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.006401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.015917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.016770 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.017053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.024756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/68e13037790741e081d38311378ddbdc/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.024756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=68e13037790741e081d38311378ddbdc, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.024756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99169d4c-167f-4590-96a3-31b77f5fd286 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.063961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.131665 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 342/699] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:54:17 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/68e13037790741e081d38311378ddbdc/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:18.166409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee27192-7a21-4ee6-b6b3-e102b0a744b1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.215648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba34dc-1c78-4130-a526-cfae8ae770b9 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.216218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba34dc-1c78-4130-a526-cfae8ae770b9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.216218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba34dc-1c78-4130-a526-cfae8ae770b9 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.217965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 343/700] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:18.226542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af75b-7fd1-431d-bc7c-f3c51807e5e9 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.226542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af75b-7fd1-431d-bc7c-f3c51807e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.226800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4af75b-7fd1-431d-bc7c-f3c51807e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.226910 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.227665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.227960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.228511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] PATH_INFO: `/v3/services/image` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.229114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.230713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:18.241652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:18.243178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.244042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 358/701] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Aug 18 20:54:17 2022] GET /identity/v3/services/image => generated 86 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:18.249041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.256819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ac4af75b-7fd1-431d-bc7c-f3c51807e5e9 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:18.258798 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ac4af75b-7fd1-431d-bc7c-f3c51807e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:18.350388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 344/702] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:18.357743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208f66-2b18-4f47-83f5-8c4a3c3cfc9b None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.357743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208f66-2b18-4f47-83f5-8c4a3c3cfc9b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.357743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65208f66-2b18-4f47-83f5-8c4a3c3cfc9b None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.357743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 345/703] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:18.359223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.359513 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.359783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.380196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:18.381647 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:18.406466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a9229-95dd-4782-b40e-ba3bb246b51b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.427719 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.447509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.448095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.453791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.453791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.453791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] RBAC: Adding query filter params (name=image) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:18.453791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.453791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.460125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 359/704] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:18.468642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.481805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 346/705] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:18 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:18.585585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054f1874-8fc3-42a1-b1a7-029c4ed7bc54 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.622224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.623258 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.623761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.624231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.625046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] RBAC: Adding query filter params (type=image) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:18.625527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.627111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.633263 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 360/706] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:18.643114 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.699205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.706262 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.763545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.775821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ca8aa-5704-40cd-af80-633c37bbf558 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.826992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.827612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.827907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.828168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.828959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] RBAC: Adding query filter params (interface=public, service_id=58b958afab2348a8a5853fcc0901668d, region_id=RegionOne) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:18.829269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.830792 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.832637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b355632f-c63d-4575-80e2-97c8efac1fc9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.841588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 347/707] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/endpoints?service_id=58b958afab2348a8a5853fcc0901668d&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:18.841588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.878878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.879734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.880142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.880776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.881784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.883665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:18.893565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:18.894888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:18.895830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 361/708] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:18.896646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.974713 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee46bca-07f5-45ee-ad5a-46bf49c06a4c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.986883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.014352 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.015369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.015921 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.016193 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] PATH_INFO: `/v3/services/network` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.016783 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.018417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9962be3-0e23-40c4-9068-20b1d615bf9e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.019147 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.029704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:19.033654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:19.036125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:19.038662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 348/709] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:19.041241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.064651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.065272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.065588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.065874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.067121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.072257 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.089641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 362/710] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:19.089641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.227190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3851c021-4cb1-4ace-b755-abcbc9d00a50 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.279165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305944-11b4-4833-b86d-95aff04933a6 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.296974 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.297599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.298685 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.298959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.299616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:19.299959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.301383 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.308155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 349/711] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:19.314213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.326584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.327200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.327474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.327739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.328380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] RBAC: Adding query filter params (name=network) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:19.328679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.330104 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.336994 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 363/712] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:19.343001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.385881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.396739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.495479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e995e0-1678-455a-ad0b-3b0dc8db40ab None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.505721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947bd99-f164-4df7-89ea-2f69e131954d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.535975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.536585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.536858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.537125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.537809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:19.538112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.539491 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.545134 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 350/713] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:19.550813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.557158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.558668 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.558944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.559214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.559851 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] RBAC: Adding query filter params (type=network) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:19.560155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.561571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.569765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 364/714] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:19.574271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.691634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.695820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9023ad8-4b88-41cd-ad76-455ba1fd753d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.738829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.739841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.740352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.740803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.741729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] RBAC: Adding query filter params (interface=public, service_id=0985d93308884b7aaddccecf633dba25, region_id=RegionOne) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:19.742215 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.743751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.752544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 365/715] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/endpoints?service_id=0985d93308884b7aaddccecf633dba25&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:19.761271 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:19.806039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde83c7-efe1-422e-909f-bb7f804c3d60 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.808005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:19.843059 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.843936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.844360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.844815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.845686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.847224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2fe78f-477b-4b9c-8b23-3278e6185079 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.893042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae6b4d-6a9d-4e73-befa-6bd65b3c39ea None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:19.930511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:19.931367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:19.932156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:19.934763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:19.938644 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:19.943909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad361752-9d0c-459d-96f3-89f6b0b10632 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:19.945323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 351/716] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:19.958908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 366/717] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:19 2022] GET /identity/v3/services => generated 1002 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:20.462870 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e1db-b488-4822-9b6f-90d226c089a6 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.463340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e1db-b488-4822-9b6f-90d226c089a6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.463421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01e1db-b488-4822-9b6f-90d226c089a6 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.465211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 352/718] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:20.471155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.472285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.472285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.492595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:20.493949 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.533712 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.601086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 367/719] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:20 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:20.926263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e1db-b488-4822-9b6f-90d226c089a6 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.037953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01e1db-b488-4822-9b6f-90d226c089a6 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.078187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.079215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.079683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.080135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.095883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:21.101052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:21.102066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:21.102959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 353/720] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:21.108514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.221588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70d8e4-9498-4ab8-afa5-16f78f1bfba0 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.261057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.262064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.262580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.263056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.264139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:21.264671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.266430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd02d7-c00d-4ace-ae7b-3bc12143c25f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.276809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 368/721] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:21.282550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.307220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:21.425577 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb0c4b-03b5-4834-8c6c-32d279418669 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.465333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.465995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.466841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.466841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.479483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.480619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd82-732a-4543-8868-e377778de62e None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.481082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.481555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd82-732a-4543-8868-e377778de62e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.481870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30fd82-732a-4543-8868-e377778de62e None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.483407 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 369/722] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:21.489989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.490306 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.490532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:21.503762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:21.504799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:21.505744 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:21.505744 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:21.505744 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:21.507971 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 354/723] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:21.517679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:21.517679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:21.518095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.543336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:21.626702 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 370/724] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:21 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:21.654013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:21.670254 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415ec9b-99cd-4105-bd7a-b86643d1616c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.710396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.711017 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.711354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.711634 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.712289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:21.712586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.714010 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.732061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 355/725] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:21.734102 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.928297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c9f07-c1a8-40e3-ae68-c376e69bd600 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.994599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.995255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.995545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.995824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] PATH_INFO: `/v3/users/nova` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.004702 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.006205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:22.018449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:22.020039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:22.021014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 371/726] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Aug 18 20:54:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:22.026144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.070216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.079781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.149642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fc5b0-bd4f-415c-9487-fd5284ec4329 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.181026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5aafe3-d710-4370-b35f-094556cd631b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.189887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.192694 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.194026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.194301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.194571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.195301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:22.195601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.197262 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.219596 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 356/727] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:22.227240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.228504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.229273 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.229636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.229998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] PATH_INFO: `/v3/services/image` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.230675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.234077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:22.255331 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:22.256874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:54:22.257788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:22.259566 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 372/728] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:22.266360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.356870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.363234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcedc56-4689-4a09-af74-44d84da937af None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.395590 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac8be09-8974-4eda-ac4a-09d2fb9b5861 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.407768 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.409043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.409715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.410202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.447347 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.449204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.449813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.450619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.451580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] RBAC: Adding query filter params (name=image) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:22.452186 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.454344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.478336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 373/729] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:22.482473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.502202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.517343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.519307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1453711-27e7-4113-be27-9bde95239fd7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.622527 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f16f7c-7b52-4996-902c-d7366efb7c83 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.647248 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 357/730] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:54:22.648579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa430e-ae90-40ba-8817-e7b39b5f3ed9 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.648855 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa430e-ae90-40ba-8817-e7b39b5f3ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.649132 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa430e-ae90-40ba-8817-e7b39b5f3ed9 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.652332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 358/731] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:22.652332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d7e8-9581-4748-b619-dc4569c8ee5e None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.652332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d7e8-9581-4748-b619-dc4569c8ee5e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.652332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3d7e8-9581-4748-b619-dc4569c8ee5e None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.653535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 359/732] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:22.658672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3d7e8-9581-4748-b619-dc4569c8ee5e None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.665096 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.665732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.666043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.666310 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.667039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] RBAC: Adding query filter params (type=image) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:22.667334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.668871 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d6e066-72f9-46e3-b51f-788e13b1e60b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.670418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.675374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 374/733] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:22.676887 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c64d7-91b9-4858-bae5-ed8e7f310a1e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.677180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c64d7-91b9-4858-bae5-ed8e7f310a1e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.677477 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c64d7-91b9-4858-bae5-ed8e7f310a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.698759 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-dc9c64d7-91b9-4858-bae5-ed8e7f310a1e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:22.700853 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-dc9c64d7-91b9-4858-bae5-ed8e7f310a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:22.782212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:22.782976 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 375/734] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:22.784718 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.785027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.785259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.805876 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:22.807272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:22.818294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3d7e8-9581-4748-b619-dc4569c8ee5e None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:22.888925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:22.890121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:22.890991 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:22.891235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:22.912159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:22.921863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 376/735] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:22 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:22.922076 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:22.922192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:22.946612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:22.947643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:22.948564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:22.948564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:22.948564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:22.948564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 360/736] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:22.954875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.029810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.089942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18b605-46bd-4c8c-af22-604ae6e976c7 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.139232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.140270 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.140615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.141042 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.141883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.144311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.147568 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06564b2f-efd1-4e87-8606-1814a8d0a5fb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.210306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.211409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.211785 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.212235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.213315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:23.213787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.216007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.232415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.242075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 361/737] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:23.243510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.302953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 377/738] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:23.302953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.379222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3818c81-6d66-4e86-936d-2eb3309cf941 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.448975 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35369543-aa41-493b-a0f7-03e69d4506e8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.450874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.451767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.452054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.452422 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.469019 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.471162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.471330 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:23.492178 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:23.493372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:23.494801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 362/739] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:23.496146 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.517450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.522256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.522256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.522256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.522256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.522256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:23.537865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:23.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:23.540459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 378/740] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:23.543484 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.597371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.666951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6ecd0-615d-4540-a55d-481d32fe98eb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.718773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb094318-edcb-433f-ac15-8f7cae2826e5 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.726565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.727627 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.728103 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.728586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] PATH_INFO: `/v3/services/network` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.729692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.732206 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:23.749310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:23.751642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:23.753932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 363/741] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/services/network => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:23.758727 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.789723 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.791126 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.791866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.792337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.793672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:23.794228 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.796982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.821834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 379/742] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:23.824297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.868537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.906312 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7a263-7c61-44b2-9e6c-c6df72547f5d None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.934313 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.954287 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.954903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.955194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.955444 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.956100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:23.956927 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.958433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.963680 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 364/743] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:23.964537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.972452 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b92be0-47c9-478d-b607-ef917719cec0 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.032709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.033589 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.033913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.034868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.035393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] RBAC: Adding query filter params (name=network) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:24.035693 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.037092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.046727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 380/744] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.046727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.130066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aad66-adb1-4643-ad24-19fa56fa7bca None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.184655 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.189748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eea36d-a8b2-43c1-9d73-d1f7822dfeea None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.195230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.196201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.196632 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.197049 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.198372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=827bfda051654edd9446aae79c093444, user.id=68e13037790741e081d38311378ddbdc) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:24.198916 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.201758 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.213685 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 365/745] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/role_assignments?user.id=68e13037790741e081d38311378ddbdc&scope.project.id=827bfda051654edd9446aae79c093444&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.214745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.254040 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.255785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.256646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.257389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.258983 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:24.259880 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.262917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.274774 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 381/746] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.340471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.441023 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbbc7d-ac0b-4992-b8ea-6387a12065af None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.518968 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.520026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.520508 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.521012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.522308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] RBAC: Adding query filter params (type=network) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:24.522836 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.525566 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ebfc0-de72-4f00-b0b2-3f0139f61cc0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.537582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 366/747] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.547540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.670443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca7a62b-2ad1-4aac-a96a-5a34f09c8a2a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.709332 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.709895 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.710176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.710453 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.711123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.712523 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc3d9-32b5-4d60-86ec-95ebff579ede None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.817358 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 382/748] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:24 2022] POST /identity/v3/endpoints => generated 337 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:25.652528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a221-40a0-4435-bb30-f2f15bfdcd21 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:25.653326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a221-40a0-4435-bb30-f2f15bfdcd21 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:25.653326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383a221-40a0-4435-bb30-f2f15bfdcd21 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:25.655449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 367/749] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:25.662627 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:25.663389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:25.663389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:25.685204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:25.686525 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:25.704883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:25.773384 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 383/750] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:25 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:26.126570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383a221-40a0-4435-bb30-f2f15bfdcd21 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.293455 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383a221-40a0-4435-bb30-f2f15bfdcd21 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.318586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.346100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.346734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.347009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.347276 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.447987 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.449382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54487d7d-7cb2-4d6d-8fba-d08fbea696b0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.642670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 368/751] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:26 2022] GET /identity/v3/auth/tokens => generated 1406 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:54:26.648788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.681455 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284d54-b61c-412c-ac50-b471bb93517e None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.682307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284d54-b61c-412c-ac50-b471bb93517e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.682471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9284d54-b61c-412c-ac50-b471bb93517e None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.684884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 369/752] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:26.692932 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29770d-7570-47be-ab60-b836a74b78e3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.693725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29770d-7570-47be-ab60-b836a74b78e3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.694183 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29770d-7570-47be-ab60-b836a74b78e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.718950 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-bc29770d-7570-47be-ab60-b836a74b78e3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:26.720223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-bc29770d-7570-47be-ab60-b836a74b78e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.729559 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.793127 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f069cbe2-c76f-483c-a4ac-d04426bafac6 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:26.828336 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 370/753] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:26.829649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63f79-4f3d-4298-b36a-3c88961ebd03 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.829929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63f79-4f3d-4298-b36a-3c88961ebd03 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.830200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af63f79-4f3d-4298-b36a-3c88961ebd03 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.831485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 371/754] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:26.837263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.837542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.837846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.844440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:26.845083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.845355 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.845718 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.860459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:26.862118 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:26.864407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:26.865686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.866600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:26.885328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:26.887634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:26.889365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:26.889365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:26.889365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:26.891879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 384/755] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:26.892853 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:26.973925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 372/756] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/auth/tokens => generated 1406 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:27.068428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88de1f9-f8c6-43ab-89bf-af3747b0e719 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.119778 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.120886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.121287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.121570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.122334 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:27.122642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.124901 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.143684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 385/757] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:27.173274 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.281825 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.317589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a88391-5b9e-48c1-a43d-0299796700f5 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.325528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.363120 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.363763 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.364041 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.364310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.364988 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.367099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.395928 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.445156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 373/758] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:27 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:27.447318 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fcc7-c0a7-4d48-9d4b-2e638b4a6d8f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.499304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.499961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.500234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.500500 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.501098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.502558 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:27.513465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:27.514766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:27.516435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 386/759] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:27.522915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.686279 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05eeda-9574-4c18-b13b-c65cd482d70a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.717207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.722745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.723352 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.723629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.723893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.724537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:27.724833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.726225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c374af-969e-4122-a9b5-f5095857da43 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.731348 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 374/760] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:27.737363 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.850179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df47ae-b897-47de-9fe3-ca4aeb834e5c None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.869997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.897117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.898197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.898686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.899172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.900226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:27.900755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.903506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5c14a8-8cd5-4b7b-b079-77c27696f579 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.912804 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 387/761] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:29.763789 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186795-47c2-4768-be32-6c0c8ea89126 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.764377 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186795-47c2-4768-be32-6c0c8ea89126 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.764658 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb186795-47c2-4768-be32-6c0c8ea89126 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.767212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 375/762] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:29.778274 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7dad9-5cf2-478e-a405-7e0082647017 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.778873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7dad9-5cf2-478e-a405-7e0082647017 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.778967 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7dad9-5cf2-478e-a405-7e0082647017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.801116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-ccf7dad9-5cf2-478e-a405-7e0082647017 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:29.802567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-ccf7dad9-5cf2-478e-a405-7e0082647017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.897354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 388/763] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:29 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:30.250186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186795-47c2-4768-be32-6c0c8ea89126 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.271204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27752-b090-4a62-ba35-7f6a8554c366 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.271599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27752-b090-4a62-ba35-7f6a8554c366 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.271992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c27752-b090-4a62-ba35-7f6a8554c366 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.273493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 389/764] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:30.286018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.286353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.286629 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.305643 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:30.306977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:30.388850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 390/765] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:30 2022] POST /identity/v3/auth/tokens => generated 1507 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:30.391730 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb186795-47c2-4768-be32-6c0c8ea89126 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.431006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.431642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.431915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.432291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.432853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.434267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:30.443746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:30.445391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:30.448210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 376/766] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:30.451367 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.505173 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.569854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ca880-6d78-4a44-9dc1-65c10c332014 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.628493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.629544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.630058 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.630543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.631709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:30.632223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.634770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.648788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 391/767] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:30.650501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.721810 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.726027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.771980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1744c-103d-4077-b465-04d02f2f081c None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.810204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.810947 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.811334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.811781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.812428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:30.812899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.814897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.820120 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 377/768] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:30.826282 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.863542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21e3fa-f63a-420f-8d07-057d67688503 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.866471 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.905102 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.905844 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.906123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.906390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.907129 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.908853 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.953740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f1cd2-59d4-442a-aa60-29cadf765797 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.981316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.985667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 392/769] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:30 2022] POST /identity/v3/services => generated 269 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:54:31.010923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:31.011975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:31.012369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:31.012823 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:31.014354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] RBAC: Adding query filter params (interface=public, service_id=be18f11b05834172bcf7575cb12fb614, region_id=RegionOne) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:31.014907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:31.017787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fd77e-fc46-493d-b1ab-e1664d09c596 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:31.032622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 378/770] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/endpoints?service_id=be18f11b05834172bcf7575cb12fb614&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:31.034199 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:31.159940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ad536-268b-4cab-bfce-4ab72f111516 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:31.195842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:31.196963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:31.196963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:31.197164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:31.197594 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:31.198977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3d51-7b8c-4b43-ad92-2adc977aa9ac None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:31.209683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 393/771] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:31 2022] GET /identity/v3/services => generated 1498 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:33.247518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368d98-cd9a-4389-9774-acc9b4c26d87 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.248089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368d98-cd9a-4389-9774-acc9b4c26d87 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.248089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368d98-cd9a-4389-9774-acc9b4c26d87 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.249399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 379/772] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:33.259162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897d71-9b30-4587-8694-db6c408edc8b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.259682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897d71-9b30-4587-8694-db6c408edc8b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.260119 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c897d71-9b30-4587-8694-db6c408edc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.290000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-9c897d71-9b30-4587-8694-db6c408edc8b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:33.292460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-9c897d71-9b30-4587-8694-db6c408edc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.331585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:33.394785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 394/773] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:33.511863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca25e-645e-4056-8979-914089f55a31 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.512052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca25e-645e-4056-8979-914089f55a31 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.512316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ca25e-645e-4056-8979-914089f55a31 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.513690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 380/774] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:33.519422 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.519708 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.519984 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.540877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:33.542188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.615475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 395/775] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:33 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:33.731453 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca25e-645e-4056-8979-914089f55a31 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.837692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ca25e-645e-4056-8979-914089f55a31 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:33.873056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:33.873716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.874122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.874393 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.875013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:33.876364 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:33.885152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:33.886327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:33.887463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:33.889977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 381/776] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:33.892355 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.943995 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.012524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.020553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.029874 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038f06a-8d95-47b7-89c3-a87187f569c5 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.072260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.072985 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.073326 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.073701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.074403 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.074706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.076094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.086209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 396/777] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:34.087346 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.090418 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7932d8d0-290e-433c-9e58-929234cdceda None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.128701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.129471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.129892 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.130171 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.130873 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.132721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:34.142490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:34.144266 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:34.145127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 382/778] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:34.150628 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.202012 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13045ca-4e84-4bad-ae79-cb23107c7a66 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.239313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.239927 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.240209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.240476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.241110 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.241408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.242817 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.247805 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 397/779] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:34.254139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.261528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea8df6-3ecf-43a1-8d56-6c71b079f42a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.274750 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.276956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.299025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.299619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.299898 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.300236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.300874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.301174 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.302617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.307137 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 383/780] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:34.312886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.362970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3b059-e241-408b-8f58-0ec0fe5470e9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.402893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.403571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.403854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.404127 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.404835 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] RBAC: Adding query filter params (interface=public, service_id=e030ac2559c14a4db547083391031c60, region_id=RegionOne) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.405141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.406551 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.412383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 398/781] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/endpoints?service_id=e030ac2559c14a4db547083391031c60&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:34.418349 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.430241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57777e3d-912a-4dba-80d3-52def0b3b989 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.478238 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.479180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.479628 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.480068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.481118 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.481643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.483732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.492269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 384/782] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:34.498656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.522964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.544882 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.553672 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c4364-3012-42e7-a08b-61c1a35e3fc1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.603974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.604704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.605070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.605411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.607080 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a2c0d-053d-4d02-9594-d5d75e478e33 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.607280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.608733 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2d4a0-686a-495e-8f33-39c59e7dda3f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.617463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 399/783] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/services => generated 1498 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:54:34.664184 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.665244 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.665784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.666284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.667528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.670237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b622e-8b87-4658-bec3-9caacb4f2d2b None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.758277 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 385/784] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:36.865006 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910500-ce48-48ef-967a-a84210b54c1b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.865557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910500-ce48-48ef-967a-a84210b54c1b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.865557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910500-ce48-48ef-967a-a84210b54c1b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.866905 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 400/785] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:36.873067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db764c3-ff18-422d-835c-e91ceafeed8f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.873602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db764c3-ff18-422d-835c-e91ceafeed8f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.873788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db764c3-ff18-422d-835c-e91ceafeed8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.897374 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-1db764c3-ff18-422d-835c-e91ceafeed8f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:36.898637 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-1db764c3-ff18-422d-835c-e91ceafeed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.976717 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 386/786] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:36 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:36.994521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea821d-5247-4e63-9937-fcd95031945c None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.994805 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea821d-5247-4e63-9937-fcd95031945c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.995403 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea821d-5247-4e63-9937-fcd95031945c None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.996530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 401/787] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:37.002455 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.002732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.003571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.023884 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:37.025147 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:37.052939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.111716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 387/788] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:37.305214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea821d-5247-4e63-9937-fcd95031945c None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.440742 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.450581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea821d-5247-4e63-9937-fcd95031945c None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.488951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.489572 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.489882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.490149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.490721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.492084 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:37.500965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:37.506056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:37.506988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 402/789] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:37.508958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.530139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.545771 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99955318-efc7-4203-a6d1-eb7af1124990 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.582723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.583251 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.583521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.583829 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.584418 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.585878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.588521 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING keystone.server.flask.common [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:54:37.626219 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f73de7f-0dfd-4269-8e99-dbaf748b2169 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.641311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.sql.core [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:54:37.641311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:54:37.641311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [parameters: {'id': '6ffa7a38ae6e45eb91d56f491bc7be6c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:54:37.641311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88585) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ffa7a38ae6e45eb91d56f491bc7be6c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ffa7a38ae6e45eb91d56f491bc7be6c. Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:54:37.657753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application result.read() Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 20:54:37.658736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application yield resource Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise self.value Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application session.commit() Aug 18 20:54:37.660584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:54:37.661582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:54:37.662526 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application result.read() Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:54:37.663906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [parameters: {'id': '6ffa7a38ae6e45eb91d56f491bc7be6c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.665205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:37.666225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6ffa7a38ae6e45eb91d56f491bc7be6c. Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.667356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 388/790] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/projects => generated 262 bytes in 220 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:37.668087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.668087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.668087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.668087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.668413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:37.668557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.668652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.668652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.674004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 403/791] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:37.681584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.682571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.754261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.775445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd5f70-057a-4bd5-b420-7ce1fff5f66d None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.791816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4264ea0f-cfc4-45c7-8077-c10b64743b00 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.814653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.815294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.815601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.815872 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.822941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.824599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.825707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.826314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:37.826587 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:37.826892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:37.827524 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:37.827849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:37.829244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:37.838125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 404/792] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:37.838337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:37.839188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:37.840124 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 389/793] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:37.841830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.843826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:37.924800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:37.960869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5cd5f8-2af8-4b73-a9ab-06276f106314 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.962309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f2ba0-b122-4e19-aa7a-e507e4a3c83f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:37.999343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.999834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:37.999967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.000209 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.000445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.000536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.000727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.000998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.001132 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:38.001434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.001695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:38.002956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a0dcb-5c7f-4777-9360-3a01882d2bf4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.003077 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0448ecba-1408-4806-9f6e-d5f27936ce08 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:38.008786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:38.024854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 390/794] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:37 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:38.100813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 405/795] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:40.379016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf871-e0d4-4166-9b21-f0d5048cf561 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.379623 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf871-e0d4-4166-9b21-f0d5048cf561 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.379730 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3cf871-e0d4-4166-9b21-f0d5048cf561 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.381009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 391/796] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:40.386537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.387041 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.387153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.406143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:40.407350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:40.456888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176dd92-c7e4-4e8e-995d-72b5172d406b None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.457256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176dd92-c7e4-4e8e-995d-72b5172d406b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.457533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176dd92-c7e4-4e8e-995d-72b5172d406b None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.458966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 392/797] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:54:40.465045 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.465330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.465599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.489646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 406/798] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:40.489872 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:40.490678 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:40.578747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 393/799] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:40 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:40.812073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:40.917774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:40.924284 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bafc35-c02f-4ec2-8f61-383dc20d363e None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:40.944499 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:40.964994 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:40.978060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:40.978060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:40.978060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:40.978060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:40.978060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:40.978622 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING keystone.server.flask.common [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:54:40.985200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.024999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.sql.core [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:54:41.024999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:54:41.024999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [parameters: {'user_id': '3bc6f8569af549cb9439599408bc8151', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:54:41.024999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88586) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:54:41.033320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2b77d-1ad2-418d-bb87-f5ae73ae6225 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application result.read() Aug 18 20:54:41.042178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:54:41.043160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application yield resource Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise self.value Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application session.commit() Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:54:41.044241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:54:41.045164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:54:41.046212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application result.read() Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:54:41.047115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [parameters: {'user_id': '3bc6f8569af549cb9439599408bc8151', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:41.047955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 20:54:41.048781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.050485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 407/800] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Aug 18 20:54:40 2022] POST /identity/v3/users => generated 160 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:41.050906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.075263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.075828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.076112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.076463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.077085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.078501 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:41.088546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:41.094371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:41.095310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 394/801] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:41.099315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.158397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf85f-3207-4f37-bf3e-7d71f838f4f9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.197999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.198642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.198922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.199190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.207649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.209337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.212131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21e9dd-4caa-4031-a283-32f78569a753 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:54:41.222373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:41.224443 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:41.226577 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 408/802] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:41.231981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.239151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.251953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.252577 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.252844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.253116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.253795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:41.254094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.255474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.260973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 395/803] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:41.267054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:41.288883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.357142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545c05-de50-4d34-b004-a40c5d1181b3 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.389589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4fcad-a241-45a3-a549-573e1f78ca37 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:41.400537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.405313 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7010ee1b-04c4-447c-ad73-a054e2207227 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.430100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:41.430987 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.434078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.434078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.434078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:41.434078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:41.434606 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a8500c-bbfb-429c-b681-4da6775214ce None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:41.439636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 396/804] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:41.448414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 409/805] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:43.724058 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18d50-f7ac-484e-8880-863409ff55e7 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:43.724602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18d50-f7ac-484e-8880-863409ff55e7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:43.724602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f18d50-f7ac-484e-8880-863409ff55e7 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:43.726066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 397/806] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:43.731845 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625927-77dd-4a7e-b286-88a656b9b34a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:43.732362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625927-77dd-4a7e-b286-88a656b9b34a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:43.732362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21625927-77dd-4a7e-b286-88a656b9b34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:43.751413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-21625927-77dd-4a7e-b286-88a656b9b34a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:43.753526 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-21625927-77dd-4a7e-b286-88a656b9b34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:43.825528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 410/807] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:43 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:44.155923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f18d50-f7ac-484e-8880-863409ff55e7 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.220306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:44.274475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f18d50-f7ac-484e-8880-863409ff55e7 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.311729 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:44.312330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.312607 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.312883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.313533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:44.315318 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02c9ad-3eb0-4348-a2dc-3ea37e94259a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:44.414662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 398/808] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:44 2022] POST /identity/v3/services => generated 242 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:46.741396 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d2a-b7c3-4353-9349-04c8b2aa9ed2 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.742003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d2a-b7c3-4353-9349-04c8b2aa9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.742003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc69d2a-b7c3-4353-9349-04c8b2aa9ed2 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.743362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 411/809] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:46.748955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:46.749438 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:46.749576 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:46.768889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:46.770145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:46.848249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 399/810] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:46 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:47.180476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69d2a-b7c3-4353-9349-04c8b2aa9ed2 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:47.210419 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:47.289803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc69d2a-b7c3-4353-9349-04c8b2aa9ed2 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:47.326891 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:47.327528 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.327807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.328076 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.328671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:47.330111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:47.339588 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:47.341828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:54:47.343828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 412/811] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:47.348854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:47.398939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:47.470086 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a0f08-963c-448c-9f63-3fd10b7b3502 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:47.504746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:47.505353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.505649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.505924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.506566 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:47.506867 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:47.508225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:47.513134 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 400/812] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:47.523280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:47.638036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:47.647222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9d0b9c-46f8-4b15-86cb-46fa5fdecd97 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:47.682585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:47.683203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.683480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.683750 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.684389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:47.684689 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:47.686103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:47.691396 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 413/813] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:47.698096 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:47.810322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:47.813289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f045b-75ac-4272-9e6a-c65257f1f326 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:47.853819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:47.854435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.854716 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.854980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.855691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] RBAC: Adding query filter params (interface=public, service_id=b54fc486026c4a60b08b304807f2dabf, region_id=RegionOne) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:47.855990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:47.857363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99c438-ffc1-48d1-b251-1a208ab9c598 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:47.863782 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 401/814] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:54:47 2022] GET /identity/v3/endpoints?service_id=b54fc486026c4a60b08b304807f2dabf&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:47.869699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:47.975381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134885b-e2f6-4e9c-a53c-a6cca69a0e77 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.011628 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.012336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.012614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.012886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:48.013505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:48.014935 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc602a0-af82-46d1-a193-deac75acdec8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:48.022437 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 414/815] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:54:47 2022] GET /identity/v3/services => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:54:50.247820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6870-36ab-4ca2-9fa6-8e3324f14652 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.248391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6870-36ab-4ca2-9fa6-8e3324f14652 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.248552 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f6870-36ab-4ca2-9fa6-8e3324f14652 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.249938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 402/816] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:50.255982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.256637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.256637 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.276914 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:50.278166 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:50.293803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:50.350398 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 415/817] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:50 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:50.687885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6870-36ab-4ca2-9fa6-8e3324f14652 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:50.801624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f6870-36ab-4ca2-9fa6-8e3324f14652 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:50.839858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:50.840550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.840826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.841095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.841707 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:50.843219 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:50.852281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:50.853518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:54:50.854838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 403/818] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:50.859390 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:50.973594 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de554aa-0ec4-4e3a-868f-ad33dcc7b586 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.013158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.013847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.014125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.014430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.015121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:51.015428 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.016897 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.023289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 416/819] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:51.029510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.063691 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.141773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1943e4-0273-4991-ac6a-482b4c91cc46 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.179127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.179748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.180024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.180292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.180933 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:51.181234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.182674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135e89b-25c4-4431-a092-a02b2f6b1169 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.188636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 404/820] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:51.196016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.214543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.303328 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5d6c5-e260-4fff-b9e6-ec8b68e68c67 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.339788 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.340403 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.340682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.340953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.341698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.343297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10590ab1-2177-451e-91f1-e9017380f6c4 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.468803 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 417/821] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:54:51 2022] POST /identity/v3/endpoints => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:55:01.186307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=54 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:01.455613 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=64,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:20.022231 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4232e5-f0ba-46f2-9313-6c2708abff2c None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.022850 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4232e5-f0ba-46f2-9313-6c2708abff2c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.022850 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4232e5-f0ba-46f2-9313-6c2708abff2c None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.024224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 405/822] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:20.030373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.031202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.031202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.051739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:20.054298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:20.138784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 418/823] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:20 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:20.475590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4232e5-f0ba-46f2-9313-6c2708abff2c None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.591679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4232e5-f0ba-46f2-9313-6c2708abff2c None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.629133 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.629777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.630052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.630316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.642213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.643788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:20.658401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:20.659910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:20.661128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:20.661128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:20.661128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:20.661128 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 406/824] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:20.666542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.770364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae649e-52e7-470b-bce2-2a3b7b4221b0 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.799770 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:20.812148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.812756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.813033 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.813302 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.813996 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:20.814445 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.815931 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200d223-35a0-447e-85bd-a0236de34c51 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.831232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 419/825] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:20.837641 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.896805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:20.945730 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b413ae16-7d85-4578-b369-af9cbf3bcd63 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.981475 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.982111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.982390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.982661 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.983314 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.984754 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242028c-6aa0-426f-adf2-323529c37053 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:21.148135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 407/826] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Aug 18 20:56:20 2022] POST /identity/v3/users => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:56:23.505039 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d8b7-977e-4738-94f5-22b3b62d6e68 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.505631 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d8b7-977e-4738-94f5-22b3b62d6e68 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.506032 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d8b7-977e-4738-94f5-22b3b62d6e68 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.508538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 420/827] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:23.514327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:23.514844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:23.514943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:23.537260 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:23.538531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:23.613081 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 408/828] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:23 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:23.953396 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d8b7-977e-4738-94f5-22b3b62d6e68 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.074243 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d8b7-977e-4738-94f5-22b3b62d6e68 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.117352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.118460 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.118948 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.119435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.132999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:24.138046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:24.139614 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:24.140642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 421/829] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:56:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:24.147197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.189959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:24.253396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e062b4be-c69a-4f4e-8ccd-dd0e3a47af30 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.291897 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.292508 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.292812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.293082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.293790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:24.294089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:24.295458 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:24.309146 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 409/830] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:56:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:24.315413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.366397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:24.421987 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b6237-9cf7-43ce-930c-3e6c756aae6e None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.457756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.458522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.458697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.458970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.470158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:24.471602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:24.485475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:24.491809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:24.492882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:24.492882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:24.492882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:24.492882 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 422/831] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:24.493167 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.606732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:24.609937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab45e6-cb42-4358-a2b6-b32092a8ec9f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.646946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.647572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.647849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.648117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.648853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:24.649158 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:24.650924 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:24.664791 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 410/832] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:24.670915 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.782550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:24.786593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a2a3b-3361-4502-9ec5-d9603a6d8d30 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:24.821771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:24.822515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.822711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.823068 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.830881 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:24.832534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:24.846758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:24.847974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:24.849086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 423/833] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:24.856529 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:24.972853 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169febb-8137-4109-87d3-640c532245a0 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.010886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.011504 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.011787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.012062 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.012813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:25.013117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.014748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.040469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 411/834] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:25.047663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.162117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49ea6a-958f-485f-a8ea-d23b34dbee0f None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.212913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.213550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.213863 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.214139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.255003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.332206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.335670 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.455656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 424/835] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:25.462367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.483241 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.568258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5f076-3a66-4844-ae50-8196eaf46f50 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.603354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.603997 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.604334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.604759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.618741 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.620273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:25.638600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:25.644863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:25.646173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:25.646173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:25.646173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:25.646173 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 412/836] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:25.646485 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.722055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.768822 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e4f7f-8db1-4007-9148-2e594fc34939 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.810533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.811143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.811411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.811678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.812405 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:25.812629 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.814028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.827100 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 425/837] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:25.836031 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.910348 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.944049 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afbdb7-3a48-421f-826c-5fb60edd015a None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.980814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.981527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.981836 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.982110 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.989249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.991286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:26.007289 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:26.009255 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:26.010849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 413/838] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:26.015229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:26.127137 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540181f3-a33e-4c4f-87af-7fa5764f8576 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:26.150869 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:26.174017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:26.174686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:26.174961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:26.175231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:26.176019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:26.176351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:26.178057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261bcdc3-be7d-4a6f-86cf-b812c6b1ff01 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:26.190893 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 426/839] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:26.198808 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:26.307109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d2a6f-32c1-44c9-a627-29fd78ea5efc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:26.337474 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:26.345930 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:26.346561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:26.348641 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:26.350042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:26.351010 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=2d082f8a806542a3a3aac3e11055a9e3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:26.351413 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:26.352935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39531-bd9f-4a63-bee1-1cdba186ce3e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:26.359141 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 414/840] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:26 2022] GET /identity/v3/role_assignments?user.id=2d082f8a806542a3a3aac3e11055a9e3&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:28.620883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eabb-e806-4d17-a81c-1cb3f6880cfd None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:28.621556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eabb-e806-4d17-a81c-1cb3f6880cfd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:28.621556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb50eabb-e806-4d17-a81c-1cb3f6880cfd None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:28.623115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 427/841] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:28.628499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:28.630322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:28.630322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:28.648267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:28.649469 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:28.720336 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 415/842] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:28 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:29.048890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50eabb-e806-4d17-a81c-1cb3f6880cfd None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.158635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb50eabb-e806-4d17-a81c-1cb3f6880cfd None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.196774 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.197401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.197706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.197982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.208240 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:29.212884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:29.214457 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:29.215678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 428/843] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:29.220194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.336156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cae53-7259-42a9-90f7-966c59ea65b4 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.363257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:29.374883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.375507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.375769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.376037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.376707 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] RBAC: Adding query filter params (name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:29.377006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:29.378517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:29.388367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 416/844] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:29.394417 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.440090 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:29.508297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f83bc3-e4ca-44ab-afca-4495f385d081 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.554125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.555207 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.555700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.556180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.575702 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:29.578470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:29.609956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:29.611018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:29.611981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:29.611981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:29.611981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:29.611981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 429/845] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:29.620385 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.731326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac793a41-9d02-4358-9154-3232b1f11377 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.771269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.771888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.772168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.772441 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.773100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:29.773522 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:29.774991 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:29.790723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 417/846] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:29.796625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:29.899649 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:29.911695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aa2e5-d658-4373-afc6-825af31638f1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:29.946658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:29.947311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:29.947592 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:29.947867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:29.956157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:29.957680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:29.970595 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:29.975900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:29.977232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 430/847] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:29.979886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.038729 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:30.097672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d2f793-a695-4a21-9474-80eee17d0424 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.137170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.137815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.138087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.138358 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.139092 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:30.139389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.140889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.159508 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 418/848] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:30.166665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.280745 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184223a-25fe-4d9b-80f7-c2714f8f91a7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.320629 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.321260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.321538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.321841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.332816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.334838 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:30.350701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:30.351791 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:30.353414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:30.353414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:30.353414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:30.353414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 431/849] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:30.358078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.469109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d2c261-2fe5-4d67-9b6f-4b5f52d91ddc None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.471723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:30.504979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.505649 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.506156 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.506616 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.507273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:30.507576 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.508977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.521942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 419/850] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:30.528594 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.534777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:30.645341 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0101ebab-7f24-4a3f-8ef8-9699821db53a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.684826 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.685575 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.685960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.686278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.694601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.696211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:30.708758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:30.710834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:30.712505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 432/851] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:30.716562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.829648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed0ced-7c07-4c68-b9c5-a10df6174236 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:30.872258 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:30.873317 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:30.873874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:30.874248 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:30.875042 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:30.875431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:30.876906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5fa836-8429-4e3e-bac0-82c0ae483942 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:30.895477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 420/852] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:30.901828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:30.967568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:31.010124 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f768147-9c7d-4a41-a1c1-ad9eaf87f0ee None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:31.048785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:31.049470 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:31.049831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:31.054370 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/2d082f8a806542a3a3aac3e11055a9e3/roles/5eff9a0ee07f41a19ce8ae91fc16a086` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:31.066883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=2d082f8a806542a3a3aac3e11055a9e3, role_id=5eff9a0ee07f41a19ce8ae91fc16a086)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:31.068504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43341f1-fa98-49de-98ba-a33c35946162 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:31.211044 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 433/853] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:56:30 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/2d082f8a806542a3a3aac3e11055a9e3/roles/5eff9a0ee07f41a19ce8ae91fc16a086 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:33.403412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16199eca-ed34-44a5-b052-24c364ed8e66 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:33.403943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16199eca-ed34-44a5-b052-24c364ed8e66 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:33.403943 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16199eca-ed34-44a5-b052-24c364ed8e66 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:33.405284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 421/854] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:33.410669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:33.411650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:33.411812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:33.429423 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:33.430798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:33.506764 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 434/855] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:33 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:33.838428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16199eca-ed34-44a5-b052-24c364ed8e66 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:33.866146 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:33.942759 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16199eca-ed34-44a5-b052-24c364ed8e66 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:33.978570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:33.979198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:33.979471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:33.979741 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:33.989843 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:33.994601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:33.995601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:33.996801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 422/856] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Aug 18 20:56:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:34.001829 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.044852 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:34.099752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b083d10-8e07-45b7-a2f6-a7df5c333f35 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:34.133010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:34.133600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:34.133933 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:34.134172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:34.134836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:34.135135 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:34.136493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:34.144529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 435/857] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:34.150941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.246057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:34.261591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274388d-b2b4-4f17-a161-133e87fb9880 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:34.297779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:34.301272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:34.301272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:34.301272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:34.309644 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:34.311099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:34.327669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:34.330863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:34.331955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:34.331955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:34.331955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:34.331955 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 423/858] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:34.335674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.441737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a732c-d097-4d1d-b3f0-06091f8e1bb9 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:34.444567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:34.479848 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:34.480459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:34.480742 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:34.481017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:34.481756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:34.482063 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:34.483433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:34.498514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 436/859] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:34.504486 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.610032 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27316b-8115-45ea-b131-4f40ffe544f4 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:34.643407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:34.644029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:34.644306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:34.644576 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:34.649177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:34.659619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:34.664351 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:34.677369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:34.678578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:34.679737 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 424/860] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:34.684530 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.787973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e388f49-5497-406a-850b-6d7c40844c5b None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:34.844268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:34.844868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:34.845142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:34.845418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:34.849216 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:34.849548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:34.851021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:34.876698 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 437/861] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:34.887940 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:34.998111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314d778-d444-4854-9c2a-4d207ad3d480 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:35.031720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:35.032308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:35.032579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:35.032847 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:35.099137 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:35.105750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:35.107217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:35.214299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 425/862] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:34 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:35.220507 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:35.250971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:35.328382 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8052c876-5978-4899-9d1f-c433c46b7823 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:35.363651 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:35.364837 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:35.365112 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:35.365376 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:35.375734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:35.377176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:35.393635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:35.395763 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:35.397669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:35.397669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:35.397669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:35.397669 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 438/863] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:35.402417 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:35.508755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:35.514951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3ad8b-a006-40ba-9d19-624b904045b4 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:35.560371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:35.560963 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:35.561237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:35.561556 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:35.562218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:35.562515 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:35.563866 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:35.575276 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 426/864] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:35.581345 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:35.666373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:35.691697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a9c3c-b4b4-46b5-ae81-c3c15f5d8c70 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:35.724790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:35.725404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:35.725710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:35.725988 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:35.732562 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:35.734038 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:35.745410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:35.746786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:35.747866 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 439/865] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:35.752997 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:35.860960 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0ec1-3de7-483e-96f2-f9363867bdc1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:35.893959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:35.894547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:35.894820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:35.895087 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:35.895773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:35.896068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:35.897479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67fdfb-1e25-4277-bdd5-e0a442cc42bb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:35.909479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 427/866] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:35.916116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:36.023455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c9248-2009-4cac-b215-4bb3f0d15ff1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:36.057362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:36.057990 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:36.058269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:36.058539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:36.059261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] RBAC: Adding query filter params (role.id=5eff9a0ee07f41a19ce8ae91fc16a086, scope.project.id=827bfda051654edd9446aae79c093444, user.id=2d082f8a806542a3a3aac3e11055a9e3) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:36.059568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:36.060997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e6f27-f53c-4b16-a058-2150f070aa5f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:36.062765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:36.067115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 440/867] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:35 2022] GET /identity/v3/role_assignments?user.id=2d082f8a806542a3a3aac3e11055a9e3&scope.project.id=827bfda051654edd9446aae79c093444&role.id=5eff9a0ee07f41a19ce8ae91fc16a086 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:38.317366 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cf26-7bba-46dd-9515-c0190f9cdfe2 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:38.318039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cf26-7bba-46dd-9515-c0190f9cdfe2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:38.318039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7cf26-7bba-46dd-9515-c0190f9cdfe2 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:38.319275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 428/868] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:38.324819 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:38.325260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:38.325467 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:38.343397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:38.344715 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:38.414800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 441/869] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:38 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:38.750793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7cf26-7bba-46dd-9515-c0190f9cdfe2 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:38.769587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:38.852979 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7cf26-7bba-46dd-9515-c0190f9cdfe2 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:38.887240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:38.887862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:38.888142 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:38.888415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:38.899387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:38.904066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:38.905121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:38.906024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 429/870] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:38.911512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.011703 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d2e3a-ceb5-4ddc-ba3a-b868c1ac94f6 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.039308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:39.047603 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.048209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.048479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.048746 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.049414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:39.049746 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.051104 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:39.059878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 442/871] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:39.065984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.147061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:39.170378 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbe949-e779-41bc-b797-66b80fa4ac57 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.204171 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.204775 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.205053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.205329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.215706 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.217129 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:39.231819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:39.233020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:39.234347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:39.234347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:39.234347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:39.234347 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 430/872] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:39.239262 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.346249 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df94f2-698a-451f-8369-f98d57169f94 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.380020 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.380611 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.380889 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.381160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.381830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:39.382134 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.383513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:39.396149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 443/873] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:39.402143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.505243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f79fda-3546-4b3c-896c-7ea5a5953995 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.535523 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:39.545231 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.545633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.545919 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.546191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.555554 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.557155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:39.569670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:39.575467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:39.576657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 431/874] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:39.577357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.629256 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:39.679636 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c8c22f-bc03-4e78-a9b2-89600a4ae2c1 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.712548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.713146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.713425 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.713727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.714504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:39.714810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.716230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:39.733870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 444/875] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:39.740439 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:39.839320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235beeda-a1d5-4fd7-93b1-991cc860af25 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:39.872873 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:39.873468 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:39.873777 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:39.874047 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:39.931100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:39.942803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:39.944253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.041950 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 432/876] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:39 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:40.047492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.153792 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3006c0-2b53-45dc-89c8-a8dc01d8199a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.164465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:40.189103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.189697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.190191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.190406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.201766 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.203214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:40.218761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:40.220008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:40.221156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:40.221156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:40.221156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:40.221156 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 445/877] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:40.226721 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.319561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:40.331641 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0615d-cdfc-4be7-8d66-7981d96053e1 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.365837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.366446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.366728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.367003 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.367656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:40.367967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.369329 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.381217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 433/878] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:40.386998 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.496860 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1049a-2f24-468f-9e6a-e04bab79b5a7 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.532115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.532736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.533015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.533286 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.540118 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.541561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:40.552569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:40.558285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:40.563906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 446/879] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:40.564517 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.660532 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30fe1-0b1a-40d0-abb5-89c4868e6278 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.696510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.697159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.697434 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.697747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.698441 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:40.698747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.700191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598472bc-7e8b-4602-b15a-0146c5ab30b7 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.713256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 434/880] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:40.719434 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:40.743017 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:40.821890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4fa286-4955-4230-82bd-bfcb5d0ee6e8 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:40.856423 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:40.857051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:40.857327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:40.857596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:40.858356 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=827bfda051654edd9446aae79c093444, user.id=2d082f8a806542a3a3aac3e11055a9e3) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:40.858656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:40.860101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9cd1ea-3ebd-4e50-a070-a0d984fec29f None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:40.865729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 447/881] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:40 2022] GET /identity/v3/role_assignments?user.id=2d082f8a806542a3a3aac3e11055a9e3&scope.project.id=827bfda051654edd9446aae79c093444&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:43.073493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2691f-5895-429d-b8c8-01dc8994f34f None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:43.074132 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2691f-5895-429d-b8c8-01dc8994f34f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:43.074132 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f2691f-5895-429d-b8c8-01dc8994f34f None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:43.075402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 435/882] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:43.080762 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:43.081191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:43.081337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:43.100545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:43.101780 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:43.176704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 448/883] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:43 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:43.501330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2691f-5895-429d-b8c8-01dc8994f34f None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:43.512509 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:43.605984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f2691f-5895-429d-b8c8-01dc8994f34f None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:43.642142 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:43.642820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:43.643095 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:43.643362 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:43.656245 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:43.661949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:43.665958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:43.667140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 436/884] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:43.671972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:43.703765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:43.796895 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4dc34a-9ea8-485b-8117-fb9a019da28b None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:43.833301 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:43.833943 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:43.834228 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:43.834506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:43.835189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:43.835491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:43.836890 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:43.845506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 449/885] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:43.852187 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:43.922681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:43.962512 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f00ff2-d9ce-4edd-a92d-6cc34bdfed11 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:43.999677 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.000401 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.000674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.000944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.013125 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.014599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:44.032435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:44.033670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:44.034885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:44.034885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:44.034885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:44.034885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 437/886] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:44.040674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.129706 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:44.152953 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0db28-ae86-47f6-94aa-89678ba19744 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:44.189351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.190072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.190349 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.190619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.191275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:44.191582 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.192960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.211000 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 450/887] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:44.217233 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.322477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae36c4f-4bc2-41c6-998a-f66d4f3d9c67 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:44.342939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:44.357659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.358296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.358570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.358839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] PATH_INFO: `/v3/users/placement` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.367828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.369263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:44.381074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:44.382224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:44.383205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 438/888] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:44.388106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.504097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf23aa-7fbb-4a92-8e55-7a385f9bcf29 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:44.539568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.540172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.540449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.540727 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.541465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:44.541793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.543248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.546214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:44.570231 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 451/889] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:44.577122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.687685 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ceb7-24d1-41a8-95d2-e873f66cccfb None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:44.732755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.733405 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.733718 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.736341 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.747162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.748628 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:44.765205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:44.766609 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:44.767620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:44.767620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:44.767620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:44.767620 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 439/890] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:44.773182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.887409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1c313-2c23-4c61-a2ee-5fec25d0a98d None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:44.928412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:44.929028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:44.929300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:44.929568 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:44.930251 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:44.930550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:44.931932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:44.945386 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 452/891] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:44.951471 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:44.988397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:45.069629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45557db3-1cc3-4c09-b91a-c75c08569db8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:45.124466 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:45.125171 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:45.125537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:45.125921 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:45.134013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:45.135555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:45.148572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:45.149959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:45.151034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:45.155511 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 440/892] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:45.161109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:45.255155 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:45.310635 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7fc0e-0d04-4949-aa84-31dd96c553ed None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:45.347640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:45.348912 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:45.349191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:45.349465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:45.350214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:45.350517 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:45.351963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ae8f5-4b7a-4659-bee7-0adc406e4172 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:45.365816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 453/893] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:45.375497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:45.506057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:45.515950 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444ec61-5093-458a-8a88-db3e08874730 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:45.556889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:45.557637 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:45.557918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:45.558189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] PATH_INFO: `/v3/projects/827bfda051654edd9446aae79c093444/users/2d082f8a806542a3a3aac3e11055a9e3/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:45.560210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] RBAC: Authorizing `identity:create_grant(project_id=827bfda051654edd9446aae79c093444, user_id=2d082f8a806542a3a3aac3e11055a9e3, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:45.561735 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7c968-3448-4920-9ffe-0e8b2e3b39fb None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:45.649076 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 441/894] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Aug 18 20:56:45 2022] PUT /identity/v3/projects/827bfda051654edd9446aae79c093444/users/2d082f8a806542a3a3aac3e11055a9e3/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:47.916128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cae6d-5c08-48da-bc71-f22f8a70dabb None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:47.916694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cae6d-5c08-48da-bc71-f22f8a70dabb None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:47.916694 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247cae6d-5c08-48da-bc71-f22f8a70dabb None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:47.918827 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 454/895] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:47.924380 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:47.924857 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:47.924959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:47.944190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:47.945407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:48.031764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 442/896] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:47 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:48.366624 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cae6d-5c08-48da-bc71-f22f8a70dabb None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:48.492414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247cae6d-5c08-48da-bc71-f22f8a70dabb None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:48.517450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:48.552578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:48.553381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.553798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.554210 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.568100 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:48.573003 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:48.574195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:48.575050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 455/897] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:48.580468 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:48.678381 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:48.704363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8fe65-780a-4307-93a0-9fea6ee5b954 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:48.744288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:48.744980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.745257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.745533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.746265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:48.746570 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:48.747956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:48.756961 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 443/898] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:48.764992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:48.883268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d98fcd-0936-4ecd-9bec-8f5e7dec00d4 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:48.921361 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:48.922114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:48.922282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:48.922569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:48.934787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:48.936185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:48.954940 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:48.956758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:48.958570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:48.958570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:48.958570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:48.958570 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 456/899] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:48.962720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.089036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca62cd97-bf56-4cf4-83d4-63839b606c87 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.129365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.130048 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.130325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.130597 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.131246 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:49.131610 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.132935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.148499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 444/900] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:49.154802 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.190506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:49.281076 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a587d1-d030-4898-a657-014cf42a8444 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.327205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.327831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.328098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.328372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.336840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.338324 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:49.361877 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:49.363189 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:49.366372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 457/901] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:49.370046 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.374306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:49.491116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70e87-fd1c-40c7-98d0-7445a468e1b0 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.531622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.532450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.532717 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.532989 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.534028 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:49.534332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.535784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.557746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 445/902] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:49.564357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.668337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:49.682297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c787a6-f4c9-44d2-90e4-3f75f3079cb2 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:49.718587 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:49.719141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:49.719416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:49.719679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:49.790353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:49.791830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:49.880294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:49.896761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 458/903] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:49.902850 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:49.970012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:50.010752 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8951-20d0-45d7-991b-58b8b2febfe8 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:50.056189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:50.056809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:50.057078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:50.057343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:50.068696 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:50.070168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:50.086814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:50.088915 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:50.089869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:50.089869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:50.089869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:50.089869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 446/904] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:50.100450 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:50.215454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff854b5-bceb-4bfc-b778-099adc7e894a None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:50.251691 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:50.252209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:50.252481 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:50.252750 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:50.253406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:50.253743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:50.255695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:50.269308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 459/905] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:50.279243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:50.429892 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae30a2-5dc6-4391-8693-95f9c399d398 None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:50.446551 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:50.471547 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:50.472235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:50.472589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:50.472911 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:50.481094 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:50.482638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:50.506196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:50.507970 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: ERROR keystone.server.flask.application Aug 18 20:56:50.509507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 447/906] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:50.514406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:50.570545 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:50.631368 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356317-3329-4bd7-aba1-148293a4c170 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:50.666660 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:50.667268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:50.667547 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:50.667846 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:50.668562 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:50.668886 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:50.670380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd1e460-3c3d-4429-b213-c7558c0127a5 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:50.685867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 460/907] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:50.693412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:50.803953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2c158-0fcb-4f65-8e65-dc57abf036cd None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:50.850708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:50.851739 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:50.852250 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:50.852746 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:50.854102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] RBAC: Adding query filter params (role.id=77fecc16fb304d4a91278ad7f4674f4e, scope.project.id=827bfda051654edd9446aae79c093444, user.id=2d082f8a806542a3a3aac3e11055a9e3) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:50.854662 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:50.857463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab4bf72-290f-4a24-b29d-f0865a95f23e None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:50.869666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 448/908] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:50 2022] GET /identity/v3/role_assignments?user.id=2d082f8a806542a3a3aac3e11055a9e3&scope.project.id=827bfda051654edd9446aae79c093444&role.id=77fecc16fb304d4a91278ad7f4674f4e => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:53.258329 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d47ad-6c00-43a3-ac51-6f96a00cf362 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:53.258907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d47ad-6c00-43a3-ac51-6f96a00cf362 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:53.258907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d47ad-6c00-43a3-ac51-6f96a00cf362 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:53.260321 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 461/909] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:53.266076 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:53.266608 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:53.266608 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:53.286155 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:53.287362 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:53.331396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:53.372986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 449/910] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:53 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:56:53.704117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d47ad-6c00-43a3-ac51-6f96a00cf362 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:53.834610 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d47ad-6c00-43a3-ac51-6f96a00cf362 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:53.842885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:53.871303 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:53.871934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:53.872242 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:53.872512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:53.873097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:53.874492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:53.883825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:53.885172 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:56:53.886480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 462/911] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Aug 18 20:56:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:53.891572 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:54.026191 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3858928-4910-4c02-81c9-ce764f047c2b None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:54.078659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:54.079284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:54.079563 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:54.079832 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:54.080481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:54.080780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:54.082800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca7740c-05ee-4a14-ae14-4a25ea50b000 None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:54.088159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 450/912] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:54.094340 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:54.206533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a75c2e-b42a-4617-b515-72def92c8c63 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:54.244202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:54.244821 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:54.245107 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:54.245378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] PATH_INFO: `/v3/services` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:54.246190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] RBAC: Adding query filter params (type=placement) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:54.246506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:54.247902 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d2d39-3fd7-4316-b8e7-1521d2bab99d None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:54.253087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 463/913] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:56.539000 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b12d0-c271-4075-8735-920c53570aeb None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:56.539550 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b12d0-c271-4075-8735-920c53570aeb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:56.539771 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b12d0-c271-4075-8735-920c53570aeb None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:56.541702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 451/914] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:56.548720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abf44-d96d-4755-bc4e-4b282b602c42 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:56.549303 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abf44-d96d-4755-bc4e-4b282b602c42 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:56.549303 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947abf44-d96d-4755-bc4e-4b282b602c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:56.568578 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-947abf44-d96d-4755-bc4e-4b282b602c42 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:56.569856 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-947abf44-d96d-4755-bc4e-4b282b602c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:56.607650 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:56.663247 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 464/915] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:56 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:56.992165 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b12d0-c271-4075-8735-920c53570aeb None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:57.029643 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:57.121371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b12d0-c271-4075-8735-920c53570aeb None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:57.171599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:57.172286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:57.172565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:57.172835 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:57.173500 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:57.174929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed32a5a-7460-4993-8ba4-1be20e0731fc None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:57.291941 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 452/916] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Aug 18 20:56:56 2022] POST /identity/v3/services => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:59.543566 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d275bbb-b8e9-429f-b2e8-1c06be75833b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:59.544124 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d275bbb-b8e9-429f-b2e8-1c06be75833b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:59.544124 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d275bbb-b8e9-429f-b2e8-1c06be75833b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:59.545486 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 465/917] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:59.550905 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:59.554813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:59.554813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:59.569529 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:59.570776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:59.649631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 453/918] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:59 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:59.989467 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d275bbb-b8e9-429f-b2e8-1c06be75833b None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.096159 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d275bbb-b8e9-429f-b2e8-1c06be75833b None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.133369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.134122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.134394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.134665 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.135260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.136645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:57:00.146903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:57:00.148197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:00.151580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 466/919] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Aug 18 20:56:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:57:00.154350 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.174920 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:00.263050 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e87d34-c7ef-4ad6-a760-5e90655d3fff None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.298578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.299216 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.299493 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.299762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.300973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] RBAC: Adding query filter params (name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:57:00.301272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.302690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.308382 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 454/920] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:57:00.315056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.345814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:00.423728 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d735a6-917f-4270-a9f5-fb5586e5f888 None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.463629 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.464688 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.465174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.465686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.467056 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] RBAC: Adding query filter params (interface=public, service_id=7a73ed84083c40b185f70ba2e589c05b, region_id=RegionOne) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:57:00.477480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.477480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47a5b5-0648-4fd6-99d2-9832dd2bf10b None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.480009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 467/921] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/endpoints?service_id=7a73ed84083c40b185f70ba2e589c05b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:57:00.485935 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:00.588650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:00.609455 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ca905-a705-4b9b-8a07-95962673e92f None admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:00.646514 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:00.647114 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:00.647389 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:00.647656 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:00.648283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:00.649657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e0114-0814-4dc4-8c0e-691cf2e5ebcd None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:00.657247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 455/922] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Aug 18 20:57:00 2022] GET /identity/v3/services => generated 1962 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:57:02.924269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c71c3-cdff-4339-bdc4-419f575b7ff8 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:02.924921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c71c3-cdff-4339-bdc4-419f575b7ff8 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:02.924921 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c71c3-cdff-4339-bdc4-419f575b7ff8 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:02.926219 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 468/923] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 20:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:02.932223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:02.932812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:02.932812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:02.952539 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:02.953811 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:03.028937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 456/924] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:02 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:57:03.366384 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c71c3-cdff-4339-bdc4-419f575b7ff8 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:03.485139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:03.495683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c71c3-cdff-4339-bdc4-419f575b7ff8 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:03.536812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:03.537552 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:03.537871 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:03.538149 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:03.538758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:03.540174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:57:03.549900 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:57:03.551732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: ERROR keystone.server.flask.application Aug 18 20:57:03.553362 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 469/925] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Aug 18 20:57:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:57:03.558907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:03.647457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:03.671964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6a161-0c6f-4631-8e0f-3fe70bf6a0a2 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:03.712951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:03.713561 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:03.714016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:03.714308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] PATH_INFO: `/v3/services` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:03.715083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] RBAC: Adding query filter params (name=placement) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:57:03.715492 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:03.717256 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561cd6b8-2ff2-4a85-889e-d8a4a61cc22c None admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:03.729300 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 457/926] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Aug 18 20:57:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:57:03.734192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:03.851070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564dd0-8863-44e8-9364-e53fddfcd1aa None admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:03.890696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:03.891302 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:03.891576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:03.891847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:03.892519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:03.894032 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1d097-a96d-4d82-a1e0-812288e05ae1 None admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:04.050753 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 470/927] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 20:57:03 2022] POST /identity/v3/endpoints => generated 331 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:57:13.721039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=30 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:14.045720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:35.668576 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42ef4-499d-49e2-939d-7a7f343b862c None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:35.669142 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42ef4-499d-49e2-939d-7a7f343b862c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:35.669536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f42ef4-499d-49e2-939d-7a7f343b862c None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:35.677536 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 458/928] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:35.678978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9669e-e425-4686-83b5-bcc712b2d7aa None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:35.679429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9669e-e425-4686-83b5-bcc712b2d7aa None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:35.679509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9669e-e425-4686-83b5-bcc712b2d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:35.766035 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-b7a9669e-e425-4686-83b5-bcc712b2d7aa None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:35.767260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-b7a9669e-e425-4686-83b5-bcc712b2d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:35.902365 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 471/929] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:04:36.266803 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f31ce5-4f9d-4c5d-9ebd-a7019719a44c None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:36.267034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f31ce5-4f9d-4c5d-9ebd-a7019719a44c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:36.267338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f31ce5-4f9d-4c5d-9ebd-a7019719a44c None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:36.268664 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 459/930] 10.222.0.26 () {54 vars in 965 bytes} [Thu Aug 18 21:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:36.281752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a54a-c069-49e7-ab81-3d731683cac5 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:36.282598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a54a-c069-49e7-ab81-3d731683cac5 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:36.283551 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213a54a-c069-49e7-ab81-3d731683cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:36.393179 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-f213a54a-c069-49e7-ab81-3d731683cac5 None None] MFA Rules not processed for user `7c02350215a147e7aeeeae512c99a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:36.394447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-f213a54a-c069-49e7-ab81-3d731683cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:36.428732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:36.481798 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 472/931] 10.222.0.26 () {58 vars in 1062 bytes} [Thu Aug 18 21:04:36 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:36.491055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f31ce5-4f9d-4c5d-9ebd-a7019719a44c None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:36.505654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f31ce5-4f9d-4c5d-9ebd-a7019719a44c None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:36.510384 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:36.511072 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:36.511348 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:36.511615 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:36.522837 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:36.524756 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95bec0-57ed-4340-9397-574f3999d681 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:36.536684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 460/932] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:39.130026 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311193-aed4-44a3-9f77-d813f69a0b26 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:39.130642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311193-aed4-44a3-9f77-d813f69a0b26 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:39.130642 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311193-aed4-44a3-9f77-d813f69a0b26 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:39.132034 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 473/933] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:39.139946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ee8-01c2-4117-9bd5-4537dffbdcc3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:39.140533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ee8-01c2-4117-9bd5-4537dffbdcc3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:39.141079 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614ee8-01c2-4117-9bd5-4537dffbdcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:39.162600 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-69614ee8-01c2-4117-9bd5-4537dffbdcc3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:39.163826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-69614ee8-01c2-4117-9bd5-4537dffbdcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:39.172334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 461/934] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:39.524493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311193-aed4-44a3-9f77-d813f69a0b26 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:39.536092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311193-aed4-44a3-9f77-d813f69a0b26 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:39.540037 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:39.540645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:39.541032 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:39.541242 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:39.551911 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:39.553656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68061756-bb2c-43d7-83d7-46b282f6cdac service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:39.564785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 474/935] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:39 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:42.462018 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bf2c-17fe-423e-a047-2685bccc1230 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.462903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bf2c-17fe-423e-a047-2685bccc1230 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.463407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2bf2c-17fe-423e-a047-2685bccc1230 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.465306 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 462/936] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:42.470440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c9c-bad6-4d3f-ab93-a99dd425334e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.470883 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c9c-bad6-4d3f-ab93-a99dd425334e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.471102 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49228c9c-bad6-4d3f-ab93-a99dd425334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.534070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-49228c9c-bad6-4d3f-ab93-a99dd425334e None None] MFA Rules not processed for user `653279e1559647a291c539cd21cc62ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:42.535287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-49228c9c-bad6-4d3f-ab93-a99dd425334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:42.627211 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 475/937] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:42.989376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99a62-ecb7-4dea-93ac-b413aeee2480 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.989780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99a62-ecb7-4dea-93ac-b413aeee2480 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.990058 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b99a62-ecb7-4dea-93ac-b413aeee2480 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:42.991462 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 463/938] 10.222.0.26 () {54 vars in 965 bytes} [Thu Aug 18 21:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:42.998224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4221-d732-4bcd-ab9e-d4442652ad1b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:42.998508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4221-d732-4bcd-ab9e-d4442652ad1b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:42.998785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4221-d732-4bcd-ab9e-d4442652ad1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:43.019999 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-2d8f4221-d732-4bcd-ab9e-d4442652ad1b None None] MFA Rules not processed for user `7c02350215a147e7aeeeae512c99a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:43.021212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-2d8f4221-d732-4bcd-ab9e-d4442652ad1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:43.028584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 476/939] 10.222.0.26 () {58 vars in 1062 bytes} [Thu Aug 18 21:04:42 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:43.038299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99a62-ecb7-4dea-93ac-b413aeee2480 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:43.049441 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b99a62-ecb7-4dea-93ac-b413aeee2480 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:43.053015 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:43.053926 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:43.054047 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:43.054235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:43.065364 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:43.068282 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511e3d0-9847-4569-8c7a-00dab7680698 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:43.086544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 464/940] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:43 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:04:46.487451 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42cfae-dac9-416d-a970-fdc84994dd91 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:46.487942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42cfae-dac9-416d-a970-fdc84994dd91 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:46.488030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42cfae-dac9-416d-a970-fdc84994dd91 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:46.489311 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 477/941] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:46.494478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c5af6-d2d1-419a-8b03-c74adf59478b None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:46.494907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c5af6-d2d1-419a-8b03-c74adf59478b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:46.495004 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c5af6-d2d1-419a-8b03-c74adf59478b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:46.513653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5e7c5af6-d2d1-419a-8b03-c74adf59478b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:46.514790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5e7c5af6-d2d1-419a-8b03-c74adf59478b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:46.590476 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 465/942] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:46 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:46.930707 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42cfae-dac9-416d-a970-fdc84994dd91 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:46.941340 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42cfae-dac9-416d-a970-fdc84994dd91 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:46.944860 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:46.945464 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:46.945773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:46.946044 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:46.955279 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:46.956709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7deacd0-bbe8-4746-bf8c-dde8b0736248 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:46.967159 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 478/943] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:46 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:50.290983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8955f-a139-44c8-b7fd-742624852dee None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:50.291562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8955f-a139-44c8-b7fd-742624852dee None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:50.291562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f8955f-a139-44c8-b7fd-742624852dee None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:50.293936 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 466/944] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:50.301214 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf63b-4771-4d10-82e2-b12cf0de3b09 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:50.301745 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf63b-4771-4d10-82e2-b12cf0de3b09 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:50.301923 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecf63b-4771-4d10-82e2-b12cf0de3b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:50.323858 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-60ecf63b-4771-4d10-82e2-b12cf0de3b09 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:50.325401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-60ecf63b-4771-4d10-82e2-b12cf0de3b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:50.333787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 479/945] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:04:50.682172 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8955f-a139-44c8-b7fd-742624852dee None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:50.698054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f8955f-a139-44c8-b7fd-742624852dee None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:50.702412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:50.703018 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:50.703290 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:50.703557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:50.713489 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:50.715900 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9c4c0-f0f2-4d16-a9e9-1b3a22fb4888 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:50.727613 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 467/946] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:53.103430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761350af-40d5-491d-b140-4a2c7cd1f092 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:53.104010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761350af-40d5-491d-b140-4a2c7cd1f092 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:53.104010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761350af-40d5-491d-b140-4a2c7cd1f092 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:53.105521 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 480/947] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:53.110818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716befdc-c027-43eb-99fe-84e3b28b6bdf None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:53.111245 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716befdc-c027-43eb-99fe-84e3b28b6bdf None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:53.111370 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716befdc-c027-43eb-99fe-84e3b28b6bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:53.131085 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-716befdc-c027-43eb-99fe-84e3b28b6bdf None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:53.132284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-716befdc-c027-43eb-99fe-84e3b28b6bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:53.140834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 468/948] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:53.498656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761350af-40d5-491d-b140-4a2c7cd1f092 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:53.516500 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761350af-40d5-491d-b140-4a2c7cd1f092 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:53.522289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:53.523229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:53.523697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:53.524164 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:53.541136 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:53.543744 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4976-c058-4511-aab9-b47660f6f07c service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:53.563901 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 481/949] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:55.852683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2779-8f33-44ce-8759-590c7e9151e9 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.853334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2779-8f33-44ce-8759-590c7e9151e9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.853334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2779-8f33-44ce-8759-590c7e9151e9 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.855217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 469/950] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:55.861053 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80698-ab93-46b4-b453-0d4c8b6ec812 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:55.865448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80698-ab93-46b4-b453-0d4c8b6ec812 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:55.865448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80698-ab93-46b4-b453-0d4c8b6ec812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:55.881875 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-dce80698-ab93-46b4-b453-0d4c8b6ec812 None None] MFA Rules not processed for user `653279e1559647a291c539cd21cc62ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:55.883081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-dce80698-ab93-46b4-b453-0d4c8b6ec812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:55.890912 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 482/951] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:55 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:56.231309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2779-8f33-44ce-8759-590c7e9151e9 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:56.242356 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2779-8f33-44ce-8759-590c7e9151e9 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:56.246007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:56.246602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:56.246874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:56.247140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:56.257078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:56.258549 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce76d8a3-0862-48ae-808f-738bb0f98952 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:56.270247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 470/952] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:56 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:59.030105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90308-c427-4844-bd63-d2d396113e91 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:59.030676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90308-c427-4844-bd63-d2d396113e91 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:59.030676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd90308-c427-4844-bd63-d2d396113e91 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:59.032002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 483/953] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:59.037485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c560-e4b3-46a7-947d-bb74e4d47035 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:59.038012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c560-e4b3-46a7-947d-bb74e4d47035 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:59.038195 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9c560-e4b3-46a7-947d-bb74e4d47035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:59.058862 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-62e9c560-e4b3-46a7-947d-bb74e4d47035 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:59.060067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-62e9c560-e4b3-46a7-947d-bb74e4d47035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:59.067934 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 471/954] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:04:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:59.418050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90308-c427-4844-bd63-d2d396113e91 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:59.424438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=100 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:59.428711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd90308-c427-4844-bd63-d2d396113e91 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:59.432206 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:59.438447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:59.438447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:59.438447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:59.442747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:59.444212 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da00b2-cee4-4036-8ad4-1212eeaf333f service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:59.454254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 484/955] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:01.759831 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756837-01de-46ec-9b53-a73201cfaa89 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:01.760376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756837-01de-46ec-9b53-a73201cfaa89 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:01.760376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7756837-01de-46ec-9b53-a73201cfaa89 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:01.762270 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 472/956] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:01.767797 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d650-7cdb-4c4f-a3a5-ae3c5d1d5cd1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:01.768224 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d650-7cdb-4c4f-a3a5-ae3c5d1d5cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:01.768825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d650-7cdb-4c4f-a3a5-ae3c5d1d5cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:01.788464 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a2b5d650-7cdb-4c4f-a3a5-ae3c5d1d5cd1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:01.789686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a2b5d650-7cdb-4c4f-a3a5-ae3c5d1d5cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:01.798051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 485/957] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:02.146968 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7756837-01de-46ec-9b53-a73201cfaa89 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:02.159160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7756837-01de-46ec-9b53-a73201cfaa89 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:02.162690 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:02.163283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:02.163557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:02.163822 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:02.173669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:02.175109 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c2f246-8a0c-4b4d-9207-31ad2a820685 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:02.185392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 473/958] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:05.092489 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8523-04b3-42a9-a8b5-033c8be82a98 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:05.093027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8523-04b3-42a9-a8b5-033c8be82a98 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:05.093027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f8523-04b3-42a9-a8b5-033c8be82a98 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:05.094408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 486/959] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:05.099564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673a6f-dd37-4ad7-9402-ca240b0705d7 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:05.100020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673a6f-dd37-4ad7-9402-ca240b0705d7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:05.100117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f673a6f-dd37-4ad7-9402-ca240b0705d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:05.108013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=71 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:05.119816 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-9f673a6f-dd37-4ad7-9402-ca240b0705d7 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:05.121030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-9f673a6f-dd37-4ad7-9402-ca240b0705d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:05.129243 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 474/960] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:05 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:05.477980 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f8523-04b3-42a9-a8b5-033c8be82a98 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:05.489230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f8523-04b3-42a9-a8b5-033c8be82a98 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:05.492935 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:05.493538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:05.493855 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:05.494129 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:05.504244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:05.505725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df8b016-a330-4052-b92d-021b20ecd0f7 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:05.516653 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 487/961] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:05 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:10.402358 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233783-71cc-43b7-8142-7308d7c2ebcc None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:10.403353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233783-71cc-43b7-8142-7308d7c2ebcc None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:10.403353 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93233783-71cc-43b7-8142-7308d7c2ebcc None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:10.404481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 475/962] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:10.410652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7776a-bd42-448e-9916-4a845811bbb2 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:10.411204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7776a-bd42-448e-9916-4a845811bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:10.411299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7776a-bd42-448e-9916-4a845811bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:10.431812 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-84a7776a-bd42-448e-9916-4a845811bbb2 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:10.433120 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-84a7776a-bd42-448e-9916-4a845811bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:10.442816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 488/963] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:10.805056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233783-71cc-43b7-8142-7308d7c2ebcc None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:10.818339 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93233783-71cc-43b7-8142-7308d7c2ebcc None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:10.821894 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:10.822503 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:10.822776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:10.823048 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:10.833073 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:10.834552 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e149f1b-d494-4679-86c0-581d2ce47fb0 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:10.844796 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 476/964] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:14.280061 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c9ab-3394-4056-aa76-d088a15209fd None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:14.280593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c9ab-3394-4056-aa76-d088a15209fd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:14.280593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d6c9ab-3394-4056-aa76-d088a15209fd None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:14.281991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 489/965] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:14.288139 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bcf4-2b35-49d9-a673-1592b4ad37a8 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:14.288634 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bcf4-2b35-49d9-a673-1592b4ad37a8 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:14.288733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1bcf4-2b35-49d9-a673-1592b4ad37a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:14.307868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-38c1bcf4-2b35-49d9-a673-1592b4ad37a8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:14.309565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-38c1bcf4-2b35-49d9-a673-1592b4ad37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:14.317900 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 477/966] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:14 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:14.659658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6c9ab-3394-4056-aa76-d088a15209fd None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:14.671007 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d6c9ab-3394-4056-aa76-d088a15209fd None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:14.674842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:14.675335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:14.675619 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:14.676008 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:14.686201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:14.687602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fc158-12bf-4619-b420-7bd663d287ca service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:14.698321 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 490/967] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:14 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:19.412889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7df73-9cc6-4988-9365-2ba2e740ab17 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.413518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7df73-9cc6-4988-9365-2ba2e740ab17 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.413518 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7df73-9cc6-4988-9365-2ba2e740ab17 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.416334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 478/968] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:19.421229 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06da92-0cc3-4556-9123-ffbc69732c65 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.422116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06da92-0cc3-4556-9123-ffbc69732c65 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.422406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d06da92-0cc3-4556-9123-ffbc69732c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.448932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-1d06da92-0cc3-4556-9123-ffbc69732c65 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:19.450276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-1d06da92-0cc3-4556-9123-ffbc69732c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:19.470100 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 491/969] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:19.819688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7df73-9cc6-4988-9365-2ba2e740ab17 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:19.831373 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7df73-9cc6-4988-9365-2ba2e740ab17 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:19.834907 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:19.835499 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:19.835770 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:19.836038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:19.845883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:19.847297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d045-d4fc-4e43-81cb-470579207a79 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:19.857197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 479/970] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:25.546612 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1f04-6c3c-4632-81d4-780cdd31abe1 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.547114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1f04-6c3c-4632-81d4-780cdd31abe1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.547114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf1f04-6c3c-4632-81d4-780cdd31abe1 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.548878 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 492/971] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:25.555801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5f61-0ebe-4ad9-aca6-aeeb0f80f2d5 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:25.556320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5f61-0ebe-4ad9-aca6-aeeb0f80f2d5 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:25.556320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea5f61-0ebe-4ad9-aca6-aeeb0f80f2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:25.683440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-b6ea5f61-0ebe-4ad9-aca6-aeeb0f80f2d5 None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:25.686268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-b6ea5f61-0ebe-4ad9-aca6-aeeb0f80f2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:25.811413 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 480/972] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:05:25 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:29.440287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=25 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:30.716850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ba6-7438-4a3b-888a-ef466b4e614b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.717828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ba6-7438-4a3b-888a-ef466b4e614b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.718109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38042ba6-7438-4a3b-888a-ef466b4e614b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.719784 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 493/973] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:30.725204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0b5-1e40-46e2-8492-8639b7e23d03 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.725805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0b5-1e40-46e2-8492-8639b7e23d03 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.725805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2b0b5-1e40-46e2-8492-8639b7e23d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.747233 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-76d2b0b5-1e40-46e2-8492-8639b7e23d03 None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:30.748776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-76d2b0b5-1e40-46e2-8492-8639b7e23d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:30.758208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 481/974] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:32.388925 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa116-8630-4bef-a4b1-0098466ce729 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.389505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa116-8630-4bef-a4b1-0098466ce729 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.389505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88aa116-8630-4bef-a4b1-0098466ce729 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.391037 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 494/975] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:32.396189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9d2d2-4374-43b8-b764-e14883594e57 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.400396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9d2d2-4374-43b8-b764-e14883594e57 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.400396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9d2d2-4374-43b8-b764-e14883594e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.418020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-81f9d2d2-4374-43b8-b764-e14883594e57 None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:32.419074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-81f9d2d2-4374-43b8-b764-e14883594e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:32.427885 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 482/976] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:05:32 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:36.483066 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ee8f-8b20-4846-a300-01456b59665b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.483991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ee8f-8b20-4846-a300-01456b59665b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.483991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e887ee8f-8b20-4846-a300-01456b59665b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.485063 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 495/977] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:36.498986 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7ce8-6f7b-4926-80cf-94078e9f2489 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.499844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7ce8-6f7b-4926-80cf-94078e9f2489 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.500318 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e7ce8-6f7b-4926-80cf-94078e9f2489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.509659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=63 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:36.535602 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-6e8e7ce8-6f7b-4926-80cf-94078e9f2489 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:36.537089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-6e8e7ce8-6f7b-4926-80cf-94078e9f2489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.560490 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 483/978] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:36.937734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594a67-987e-4bf8-8ee6-05317e02d4e4 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.938019 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594a67-987e-4bf8-8ee6-05317e02d4e4 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.938492 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf594a67-987e-4bf8-8ee6-05317e02d4e4 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.940036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 496/979] 10.222.0.26 () {54 vars in 962 bytes} [Thu Aug 18 21:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:05:36.949590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634d32-94dd-4dff-a2b0-c253c96b81c9 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.950617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634d32-94dd-4dff-a2b0-c253c96b81c9 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.951292 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e634d32-94dd-4dff-a2b0-c253c96b81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.034325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-0e634d32-94dd-4dff-a2b0-c253c96b81c9 None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:37.036118 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-0e634d32-94dd-4dff-a2b0-c253c96b81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:37.142002 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 484/980] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Aug 18 21:05:36 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:37.149387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594a67-987e-4bf8-8ee6-05317e02d4e4 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:37.168319 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf594a67-987e-4bf8-8ee6-05317e02d4e4 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:37.173546 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:37.175847 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:37.176409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:37.176757 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.187065 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:37.188786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2cc46-6eb6-4b0b-a2fa-b1f3bb548cbf service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:37.199804 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 497/981] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:37 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:39.795288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660b339-ffae-47aa-a23c-c215635d6f6f None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.795825 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660b339-ffae-47aa-a23c-c215635d6f6f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.795825 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660b339-ffae-47aa-a23c-c215635d6f6f None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.797659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 485/982] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:39.802785 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ec93-7577-4d86-91e6-b58d847b6a60 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:39.803684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ec93-7577-4d86-91e6-b58d847b6a60 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:39.803965 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5ec93-7577-4d86-91e6-b58d847b6a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:39.859001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-06f5ec93-7577-4d86-91e6-b58d847b6a60 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:39.860193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-06f5ec93-7577-4d86-91e6-b58d847b6a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:39.869258 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 498/983] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:40.248144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660b339-ffae-47aa-a23c-c215635d6f6f None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:40.263235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660b339-ffae-47aa-a23c-c215635d6f6f None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:40.268583 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:40.269259 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:40.269635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:40.270065 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:40.282184 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:40.285807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c3234-a9ca-4126-82e3-a6cb40b16453 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:40.301311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 486/984] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:43.175973 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd94f7-b835-406f-8d20-c094d6ea1b98 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.176509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd94f7-b835-406f-8d20-c094d6ea1b98 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.176620 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd94f7-b835-406f-8d20-c094d6ea1b98 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.178014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 499/985] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:43.185659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959862d0-0db8-4c46-b201-d6b4ebc15f4c None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.185659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959862d0-0db8-4c46-b201-d6b4ebc15f4c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.185659 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959862d0-0db8-4c46-b201-d6b4ebc15f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.210472 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-959862d0-0db8-4c46-b201-d6b4ebc15f4c None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:43.211618 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-959862d0-0db8-4c46-b201-d6b4ebc15f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:43.221530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 487/986] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:43.618440 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d4b08-7669-49f1-ae74-c196be8678e8 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.618730 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d4b08-7669-49f1-ae74-c196be8678e8 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.618978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d4b08-7669-49f1-ae74-c196be8678e8 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.620777 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 500/987] 10.222.0.26 () {54 vars in 962 bytes} [Thu Aug 18 21:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:05:43.629942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bd13-d160-4720-8631-a1565433a559 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.630323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bd13-d160-4720-8631-a1565433a559 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.630650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c48bd13-d160-4720-8631-a1565433a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.666091 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-6c48bd13-d160-4720-8631-a1565433a559 None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:43.668447 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-6c48bd13-d160-4720-8631-a1565433a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:43.684992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 488/988] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Aug 18 21:05:43 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:43.694285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d4b08-7669-49f1-ae74-c196be8678e8 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:43.712818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d4b08-7669-49f1-ae74-c196be8678e8 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:43.720466 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:43.722299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.722299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.722755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.734691 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:43.737701 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498953c-5d00-437b-ae59-49f2612147b0 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:43.755188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 501/989] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:43 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:46.362760 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770e28-f60f-4f9d-82f5-e529e67d0f37 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.363654 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770e28-f60f-4f9d-82f5-e529e67d0f37 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.364101 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2770e28-f60f-4f9d-82f5-e529e67d0f37 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.370430 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 489/990] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:46.373519 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218d7b-dc6a-4355-b0e2-8bb2424dc664 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.375011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218d7b-dc6a-4355-b0e2-8bb2424dc664 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.375444 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa218d7b-dc6a-4355-b0e2-8bb2424dc664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.403626 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-aa218d7b-dc6a-4355-b0e2-8bb2424dc664 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:46.405781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-aa218d7b-dc6a-4355-b0e2-8bb2424dc664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:46.429903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 502/991] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:46.841386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2770e28-f60f-4f9d-82f5-e529e67d0f37 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.856357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2770e28-f60f-4f9d-82f5-e529e67d0f37 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.861787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.862631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.863116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.863669 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.874392 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.876276 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bb4ea4-dfed-4fa8-ba7f-d34bfd5b26d9 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.900693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 490/992] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:48.344562 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aebb6-4b94-43e2-9b67-f178462ed909 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.345242 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aebb6-4b94-43e2-9b67-f178462ed909 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.345760 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58aebb6-4b94-43e2-9b67-f178462ed909 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.348358 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 503/993] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:48.354299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d585-d726-46ee-baf6-c668a385f2db None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.355758 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d585-d726-46ee-baf6-c668a385f2db None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.356221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d585-d726-46ee-baf6-c668a385f2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.377883 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-7cb0d585-d726-46ee-baf6-c668a385f2db None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:48.379143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-7cb0d585-d726-46ee-baf6-c668a385f2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:48.387661 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 491/994] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:48 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:49.034580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144de11-8368-423a-ba88-24a0cee2c374 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.034580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144de11-8368-423a-ba88-24a0cee2c374 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.034580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144de11-8368-423a-ba88-24a0cee2c374 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.034580 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 504/995] 10.222.0.26 () {54 vars in 964 bytes} [Thu Aug 18 21:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:49.039877 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9b730-078d-4eae-9147-761f97d196be None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.040160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9b730-078d-4eae-9147-761f97d196be None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.040441 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9b730-078d-4eae-9147-761f97d196be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.111852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-30c9b730-078d-4eae-9147-761f97d196be None None] MFA Rules not processed for user `e6c53c1c9519490f854adc67392e28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.114086 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-30c9b730-078d-4eae-9147-761f97d196be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.182910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:49.203805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 492/996] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.213031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144de11-8368-423a-ba88-24a0cee2c374 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:49.227107 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144de11-8368-423a-ba88-24a0cee2c374 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:49.232602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c53c1c9519490f854adc67392e28d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:49.233597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.234282 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.234767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.246431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.248352 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75318987-8f10-4c71-8e83-dc7828f77668 service cinder] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.262555 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 505/997] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:49.428634 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dca3d-8ccc-47fd-880b-8e3b1c22ed17 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.429267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dca3d-8ccc-47fd-880b-8e3b1c22ed17 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.429267 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dca3d-8ccc-47fd-880b-8e3b1c22ed17 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.430635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 493/998] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:05:49.439652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0443a-de5a-4333-9a5b-90a1e8260e36 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.440350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0443a-de5a-4333-9a5b-90a1e8260e36 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.440350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0443a-de5a-4333-9a5b-90a1e8260e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.466456 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4ac0443a-de5a-4333-9a5b-90a1e8260e36 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.468132 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4ac0443a-de5a-4333-9a5b-90a1e8260e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.476751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 506/999] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.858657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dca3d-8ccc-47fd-880b-8e3b1c22ed17 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:49.873858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dca3d-8ccc-47fd-880b-8e3b1c22ed17 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:49.880145 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:49.881247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.881694 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.882038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.893554 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.895629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52801efd-363c-4d22-a839-08c63fd19847 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.912097 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 494/1000] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:52.506954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb14a2-b404-4730-8d29-1d246e2f00ee None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.507557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb14a2-b404-4730-8d29-1d246e2f00ee None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.507557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecb14a2-b404-4730-8d29-1d246e2f00ee None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.508850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 507/1001] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:05:52.515415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abf064-4104-4d2a-8f77-a5d57825fac6 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.515967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abf064-4104-4d2a-8f77-a5d57825fac6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.515967 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abf064-4104-4d2a-8f77-a5d57825fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.537069 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-81abf064-4104-4d2a-8f77-a5d57825fac6 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:52.538316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-81abf064-4104-4d2a-8f77-a5d57825fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.548695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 495/1002] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:52.913473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb14a2-b404-4730-8d29-1d246e2f00ee None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.927627 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecb14a2-b404-4730-8d29-1d246e2f00ee None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.932515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.933187 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.933439 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.933747 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.943959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.945972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28280391-5a39-479d-ac94-2c45454b4212 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.960061 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 508/1003] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:55.425107 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345dbc-6220-473b-98fa-01154dbb174d None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:55.425764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345dbc-6220-473b-98fa-01154dbb174d None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:55.425764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345dbc-6220-473b-98fa-01154dbb174d None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:55.427007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 496/1004] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:55.432244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4001-5aa1-4939-8b75-22bf725fac33 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:55.432676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4001-5aa1-4939-8b75-22bf725fac33 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:55.432768 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e4001-5aa1-4939-8b75-22bf725fac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:55.453190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-972e4001-5aa1-4939-8b75-22bf725fac33 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:55.454418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-972e4001-5aa1-4939-8b75-22bf725fac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:55.479903 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 509/1005] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:55.826020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f345dbc-6220-473b-98fa-01154dbb174d None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:55.840715 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f345dbc-6220-473b-98fa-01154dbb174d None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:55.845846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:55.846448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:55.846730 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:55.847154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:55.856617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:55.858427 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b1951-020c-4649-9dc2-9813c9702d3a service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:55.869586 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 497/1006] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:58.115399 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2c26-b9ad-425e-8069-29301b5d6f68 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.115954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2c26-b9ad-425e-8069-29301b5d6f68 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.115954 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b2c26-b9ad-425e-8069-29301b5d6f68 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.117268 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 510/1007] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:58.128357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8634e-f5e1-4194-9de8-3cef48d8f9d4 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.128852 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8634e-f5e1-4194-9de8-3cef48d8f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.130119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8634e-f5e1-4194-9de8-3cef48d8f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.159999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-dbf8634e-f5e1-4194-9de8-3cef48d8f9d4 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:58.161751 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-dbf8634e-f5e1-4194-9de8-3cef48d8f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:58.171767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 498/1008] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:58.528098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b2c26-b9ad-425e-8069-29301b5d6f68 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.542140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b2c26-b9ad-425e-8069-29301b5d6f68 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.547639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.548240 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.548554 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.548838 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.557343 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.559007 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aef3abe-9293-40d2-a975-337611d3de35 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.568892 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 511/1009] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:01.774860 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767f7e-2b82-4ec5-9d31-62efba5d84ab None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:01.775574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767f7e-2b82-4ec5-9d31-62efba5d84ab None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:01.775574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89767f7e-2b82-4ec5-9d31-62efba5d84ab None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:01.777397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 499/1010] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:06:01.783266 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad9d3-d893-4a08-804b-020eccf8004f None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:01.786205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad9d3-d893-4a08-804b-020eccf8004f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:01.786205 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ad9d3-d893-4a08-804b-020eccf8004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:01.792493 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=43 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:01.805064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-970ad9d3-d893-4a08-804b-020eccf8004f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:01.806238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-970ad9d3-d893-4a08-804b-020eccf8004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:01.814452 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 512/1011] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:02.422906 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89767f7e-2b82-4ec5-9d31-62efba5d84ab None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:02.437477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89767f7e-2b82-4ec5-9d31-62efba5d84ab None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:02.444009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:02.444009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:02.444009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:02.444009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:02.454093 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:02.455815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aac0cc-486b-4856-ac01-7ac1b6acfad8 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:02.471799 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 500/1012] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:05.553828 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c884cf-c7eb-4dd3-8fac-6920c5a83bd9 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:05.554522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c884cf-c7eb-4dd3-8fac-6920c5a83bd9 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:05.554522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c884cf-c7eb-4dd3-8fac-6920c5a83bd9 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:05.555806 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 513/1013] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:05.561510 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18e03-dc9e-4a67-9d4c-5326704e75bf None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:05.562089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18e03-dc9e-4a67-9d4c-5326704e75bf None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:05.562089 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d18e03-dc9e-4a67-9d4c-5326704e75bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:05.582613 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-95d18e03-dc9e-4a67-9d4c-5326704e75bf None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:05.583747 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-95d18e03-dc9e-4a67-9d4c-5326704e75bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:05.592404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 501/1014] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:05 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:05.944435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c884cf-c7eb-4dd3-8fac-6920c5a83bd9 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:05.958225 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c884cf-c7eb-4dd3-8fac-6920c5a83bd9 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:05.963741 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:05.964338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:05.964654 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:05.964989 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:05.973482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:05.975116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13caabf4-6793-4c52-b3d3-d8a3e90b27b5 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:05.985571 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 514/1015] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:06.365701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754feea-3702-491e-9324-319f3d363111 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.366030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754feea-3702-491e-9324-319f3d363111 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.366344 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754feea-3702-491e-9324-319f3d363111 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.367705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 502/1016] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:06.373341 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0f60-5463-4735-b254-8b9e45aa4f63 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.373670 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0f60-5463-4735-b254-8b9e45aa4f63 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.373945 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0f60-5463-4735-b254-8b9e45aa4f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.393508 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-263d0f60-5463-4735-b254-8b9e45aa4f63 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:06.394835 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-263d0f60-5463-4735-b254-8b9e45aa4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:06.404033 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 515/1017] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:06.769990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f5ed-06fd-4b29-b3e2-53a88ed3f9b4 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.770557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f5ed-06fd-4b29-b3e2-53a88ed3f9b4 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.770557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca0f5ed-06fd-4b29-b3e2-53a88ed3f9b4 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.771844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 503/1018] 10.222.0.26 () {54 vars in 967 bytes} [Thu Aug 18 21:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:06.777158 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5aa57-8ebc-4025-8ff5-872b9cbc5980 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.779579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5aa57-8ebc-4025-8ff5-872b9cbc5980 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.779579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5aa57-8ebc-4025-8ff5-872b9cbc5980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.830796 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5ed5aa57-8ebc-4025-8ff5-872b9cbc5980 None None] MFA Rules not processed for user `67de97570521456da7cea34e7994dbef`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:06.832033 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5ed5aa57-8ebc-4025-8ff5-872b9cbc5980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:06.894916 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 516/1019] 10.222.0.26 () {58 vars in 1064 bytes} [Thu Aug 18 21:06:06 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:06.902848 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f5ed-06fd-4b29-b3e2-53a88ed3f9b4 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:06.916888 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca0f5ed-06fd-4b29-b3e2-53a88ed3f9b4 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:06.921338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67de97570521456da7cea34e7994dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:06.922196 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.922483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.922770 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.933720 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:06.935638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7cde3-2099-4054-866e-10ee44da4f84 service glance] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:06.946397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 504/1020] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:08.401504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a724-f570-42d5-9636-cbe7be11867c None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.402235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a724-f570-42d5-9636-cbe7be11867c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.402235 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30a724-f570-42d5-9636-cbe7be11867c None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.403455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 517/1021] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:08.408944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5bb5-f638-4197-8e6d-282717e56e81 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.409415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5bb5-f638-4197-8e6d-282717e56e81 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.409522 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae5bb5-f638-4197-8e6d-282717e56e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.429470 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d9ae5bb5-f638-4197-8e6d-282717e56e81 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:08.431188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d9ae5bb5-f638-4197-8e6d-282717e56e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:08.439595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 505/1022] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:08.890667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a724-f570-42d5-9636-cbe7be11867c None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:08.890667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30a724-f570-42d5-9636-cbe7be11867c None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:08.890667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:08.890667 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.891599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.891599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.891599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:08.891599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f2a9d-2540-445b-9c85-e06060023b17 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:08.891599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 518/1023] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:11.554188 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915750-18f3-4391-9885-9942f078433e None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.554904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915750-18f3-4391-9885-9942f078433e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.554904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96915750-18f3-4391-9885-9942f078433e None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.556261 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 506/1024] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:11.563093 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb17e6-7f6d-48d8-9c11-f5d7f6596174 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.565736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb17e6-7f6d-48d8-9c11-f5d7f6596174 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.565736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb17e6-7f6d-48d8-9c11-f5d7f6596174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.596394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-66cb17e6-7f6d-48d8-9c11-f5d7f6596174 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:11.596394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-66cb17e6-7f6d-48d8-9c11-f5d7f6596174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.602525 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 519/1025] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:06:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:11.986817 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96915750-18f3-4391-9885-9942f078433e None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.010119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96915750-18f3-4391-9885-9942f078433e None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.023291 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.024268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.024755 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.025198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.035330 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.037376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e41480-8ede-4ea7-8ca7-e42430d304f5 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.050411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 507/1026] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:21.584712 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=58 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:22.044925 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=47 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:23.133089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acf67-0cc9-47c5-ab86-b22c5a0353e1 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.133836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acf67-0cc9-47c5-ab86-b22c5a0353e1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.133836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63acf67-0cc9-47c5-ab86-b22c5a0353e1 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.134982 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 520/1027] 10.222.0.26 () {54 vars in 918 bytes} [Thu Aug 18 21:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:23.140142 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5106a-50d9-4d60-b207-f3bcbf7854cb None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.140617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5106a-50d9-4d60-b207-f3bcbf7854cb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.140725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5106a-50d9-4d60-b207-f3bcbf7854cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.159420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-74b5106a-50d9-4d60-b207-f3bcbf7854cb None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:23.160618 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-74b5106a-50d9-4d60-b207-f3bcbf7854cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:23.169839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 508/1028] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Aug 18 21:06:23 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:23.184455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a45-9c77-45d4-95ee-bdea70a8bc6b None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.184736 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a45-9c77-45d4-95ee-bdea70a8bc6b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.185001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624a45-9c77-45d4-95ee-bdea70a8bc6b None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.186378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 521/1029] 10.222.0.26 () {54 vars in 918 bytes} [Thu Aug 18 21:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:23.191391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f35-3faf-4bdf-81ae-2fcb468565f7 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.191672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f35-3faf-4bdf-81ae-2fcb468565f7 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.191946 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc9f35-3faf-4bdf-81ae-2fcb468565f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.211215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-bbbc9f35-3faf-4bdf-81ae-2fcb468565f7 None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:23.212412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-bbbc9f35-3faf-4bdf-81ae-2fcb468565f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:23.220982 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 509/1030] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Aug 18 21:06:23 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.960673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7776f-01d9-45ee-a0e0-03a03458c696 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.961304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7776f-01d9-45ee-a0e0-03a03458c696 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.961304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7776f-01d9-45ee-a0e0-03a03458c696 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.962661 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 522/1031] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:25.968672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34166e-750a-4350-8f5c-c670e3d385df None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.969222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34166e-750a-4350-8f5c-c670e3d385df None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.969222 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e34166e-750a-4350-8f5c-c670e3d385df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.989116 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-3e34166e-750a-4350-8f5c-c670e3d385df None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.990350 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-3e34166e-750a-4350-8f5c-c670e3d385df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.998985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 510/1032] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:26.346374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7776f-01d9-45ee-a0e0-03a03458c696 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:26.361213 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7776f-01d9-45ee-a0e0-03a03458c696 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:26.368106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:26.368106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:26.368106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:26.368106 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:26.376453 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.378088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e5201-94d3-4d64-8e17-db734fca3a00 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.388048 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 523/1033] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:27.367005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2585-b39c-4f45-b00b-31ee92d37d22 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.367562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2585-b39c-4f45-b00b-31ee92d37d22 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.367562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2585-b39c-4f45-b00b-31ee92d37d22 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.369009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 511/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:27.374808 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a299c-309e-41c8-b60a-76e82a250aa2 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.378222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a299c-309e-41c8-b60a-76e82a250aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.378222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a299c-309e-41c8-b60a-76e82a250aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.395467 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-643a299c-309e-41c8-b60a-76e82a250aa2 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:27.396679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-643a299c-309e-41c8-b60a-76e82a250aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:27.404700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 524/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:27.593404 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2585-b39c-4f45-b00b-31ee92d37d22 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.607037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2585-b39c-4f45-b00b-31ee92d37d22 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.612546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.616021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.616021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.616021 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.623112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.624739 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d121190-ec93-4bf8-a0b6-6bed8a5b52b7 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.635001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 512/1036] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:28.566840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676e03-b034-4f27-b8f8-fe2950c4acc1 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.567364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676e03-b034-4f27-b8f8-fe2950c4acc1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.567364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e676e03-b034-4f27-b8f8-fe2950c4acc1 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.568821 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 525/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:28.574340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840632-7795-4275-88fd-77310a102389 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.574780 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840632-7795-4275-88fd-77310a102389 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.574874 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8840632-7795-4275-88fd-77310a102389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.594460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-c8840632-7795-4275-88fd-77310a102389 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:28.595686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-c8840632-7795-4275-88fd-77310a102389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:28.603569 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 513/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:28 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:28.760350 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e676e03-b034-4f27-b8f8-fe2950c4acc1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:28.774615 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e676e03-b034-4f27-b8f8-fe2950c4acc1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:28.779918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:28.780511 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.780787 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.781060 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.790388 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:28.792553 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621940a-5b41-4b8b-8654-b774a3f70ec9 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:28.803371 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 526/1039] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:29.682814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedc403-85c8-4039-85b3-97d42ccea301 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:29.683390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedc403-85c8-4039-85b3-97d42ccea301 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:29.683390 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eedc403-85c8-4039-85b3-97d42ccea301 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:29.684683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 514/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:29.690174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc798-a92f-4f35-95c2-7756e1fb2bfd None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:29.690640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc798-a92f-4f35-95c2-7756e1fb2bfd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:29.690765 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3dc798-a92f-4f35-95c2-7756e1fb2bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:29.712030 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4d3dc798-a92f-4f35-95c2-7756e1fb2bfd None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:29.713251 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4d3dc798-a92f-4f35-95c2-7756e1fb2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:29.722139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 527/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:29.878534 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedc403-85c8-4039-85b3-97d42ccea301 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:29.893647 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eedc403-85c8-4039-85b3-97d42ccea301 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:29.898725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:29.899328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:29.899605 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:29.899875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:29.912383 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:29.914031 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da3a8c-b833-4eaa-bd56-5127651f20ab service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:29.924816 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 515/1042] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:30.810218 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d90e-4968-4ece-bbfd-ea4230b1d7cf None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:30.810761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d90e-4968-4ece-bbfd-ea4230b1d7cf None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:30.810761 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947d90e-4968-4ece-bbfd-ea4230b1d7cf None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:30.812022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 528/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:30.817194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df70560-f68c-43b2-b0a1-caeee5ec856c None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:30.817703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df70560-f68c-43b2-b0a1-caeee5ec856c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:30.817806 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df70560-f68c-43b2-b0a1-caeee5ec856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:30.838530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-7df70560-f68c-43b2-b0a1-caeee5ec856c None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:30.840261 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-7df70560-f68c-43b2-b0a1-caeee5ec856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:30.848265 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 516/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:31.013091 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947d90e-4968-4ece-bbfd-ea4230b1d7cf None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:31.027228 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947d90e-4968-4ece-bbfd-ea4230b1d7cf None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:31.032263 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:31.032849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.033121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.033387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.042869 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:31.044465 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961bce-39aa-48f0-abf0-b2888bd2f5cf service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:31.054639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 529/1045] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:31.971617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc46b2-62d6-444d-a8e4-8811b30f95a2 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.972199 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc46b2-62d6-444d-a8e4-8811b30f95a2 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.972309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc46b2-62d6-444d-a8e4-8811b30f95a2 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.973681 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 517/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:31.978944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8950f-e0d3-41a7-92d6-5a4b0181fd0a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.979412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8950f-e0d3-41a7-92d6-5a4b0181fd0a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.980043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8950f-e0d3-41a7-92d6-5a4b0181fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.999401 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a0f8950f-e0d3-41a7-92d6-5a4b0181fd0a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:32.000573 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a0f8950f-e0d3-41a7-92d6-5a4b0181fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:32.008494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 530/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:32.162110 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc46b2-62d6-444d-a8e4-8811b30f95a2 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:32.176322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc46b2-62d6-444d-a8e4-8811b30f95a2 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:32.181418 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:32.182047 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:32.182355 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:32.183298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:32.191408 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:32.192980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54141737-40a9-4b45-a968-13035a92e3c0 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:32.202409 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 518/1048] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:33.131355 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18add6-2159-4f1b-8cd2-4bac4e4c4936 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.131942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18add6-2159-4f1b-8cd2-4bac4e4c4936 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.131942 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18add6-2159-4f1b-8cd2-4bac4e4c4936 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.133243 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 531/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:33.139075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760d50-0aeb-4c81-ba27-e5262632237b None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.139590 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760d50-0aeb-4c81-ba27-e5262632237b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.139695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760d50-0aeb-4c81-ba27-e5262632237b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.159014 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d7760d50-0aeb-4c81-ba27-e5262632237b None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:33.160233 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d7760d50-0aeb-4c81-ba27-e5262632237b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:33.168376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 519/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:33.324482 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18add6-2159-4f1b-8cd2-4bac4e4c4936 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:33.338289 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18add6-2159-4f1b-8cd2-4bac4e4c4936 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:33.343648 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:33.344234 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.344512 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.344782 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.353348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:33.355576 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639d7e39-4231-46d7-b94f-088cb3a3ca77 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:33.365459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 532/1051] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:34.258739 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06cb0-07ab-463a-bd2a-958247a8cde5 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.268878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06cb0-07ab-463a-bd2a-958247a8cde5 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.268878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd06cb0-07ab-463a-bd2a-958247a8cde5 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.268878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 520/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:06:34.269336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86615bb-55db-4ea4-a3e0-5dedc8a27251 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.269336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86615bb-55db-4ea4-a3e0-5dedc8a27251 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.269336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86615bb-55db-4ea4-a3e0-5dedc8a27251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.288515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a86615bb-55db-4ea4-a3e0-5dedc8a27251 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:34.289773 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a86615bb-55db-4ea4-a3e0-5dedc8a27251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:34.298397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 533/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:34.465308 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd06cb0-07ab-463a-bd2a-958247a8cde5 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:34.483553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd06cb0-07ab-463a-bd2a-958247a8cde5 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:34.489068 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:34.489726 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.490009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.490284 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.499337 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:34.500962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913659c-af43-4432-9054-da79bdd5aa46 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:34.513037 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 521/1054] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:35.386501 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ac12-f74d-48f8-9fc0-b595db74ad48 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.387064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ac12-f74d-48f8-9fc0-b595db74ad48 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.387064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796ac12-f74d-48f8-9fc0-b595db74ad48 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.388372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 534/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:06:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:35.394180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170b79-2e3f-4709-9e49-3fb90af2f3e8 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.394679 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170b79-2e3f-4709-9e49-3fb90af2f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.394779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44170b79-2e3f-4709-9e49-3fb90af2f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.414049 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-44170b79-2e3f-4709-9e49-3fb90af2f3e8 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:35.415253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-44170b79-2e3f-4709-9e49-3fb90af2f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.423333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 522/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:35.582984 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ac12-f74d-48f8-9fc0-b595db74ad48 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.597128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796ac12-f74d-48f8-9fc0-b595db74ad48 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.602086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.603023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.603023 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.603241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.612850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.614509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039413b-f35c-4bfb-9790-4af943f1a4ab service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.625011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 535/1057] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:35 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:37.735562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0f00-8ddc-497e-838d-e582ea470a89 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.736304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0f00-8ddc-497e-838d-e582ea470a89 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.736304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a0f00-8ddc-497e-838d-e582ea470a89 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.737459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 523/1058] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:37.742746 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455490-82f4-49e8-ad22-6f51a3ac36d3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.743153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455490-82f4-49e8-ad22-6f51a3ac36d3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.743298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70455490-82f4-49e8-ad22-6f51a3ac36d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.763959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-70455490-82f4-49e8-ad22-6f51a3ac36d3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:37.765181 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-70455490-82f4-49e8-ad22-6f51a3ac36d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:37.773024 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 536/1059] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:37 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:38.112953 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0f00-8ddc-497e-838d-e582ea470a89 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:38.124316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a0f00-8ddc-497e-838d-e582ea470a89 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:38.129749 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:38.130340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:38.130617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:38.130886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:38.139740 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:38.141159 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063b51e-b664-4cf8-be6b-9aa33ae451eb service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:38.150450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 524/1060] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:40.636308 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159eef-d77e-431e-84f5-097040f461c7 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:40.636842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159eef-d77e-431e-84f5-097040f461c7 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:40.636842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f159eef-d77e-431e-84f5-097040f461c7 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:40.638201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 537/1061] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:40.643465 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ef61-f47f-4020-8246-a6c94c160373 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:40.649074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ef61-f47f-4020-8246-a6c94c160373 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:40.649074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7ef61-f47f-4020-8246-a6c94c160373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:40.666507 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-dba7ef61-f47f-4020-8246-a6c94c160373 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:40.667699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-dba7ef61-f47f-4020-8246-a6c94c160373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:40.676112 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 525/1062] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:41.018436 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f159eef-d77e-431e-84f5-097040f461c7 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:41.029215 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f159eef-d77e-431e-84f5-097040f461c7 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:41.032726 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:41.033312 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:41.033590 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:41.033884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:41.043372 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:41.044885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e546ea-1eba-4e07-9f48-816dfce30757 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:41.054182 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 538/1063] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:43.728893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69678ed-e742-4d55-b481-c34fcf2bc84a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:43.729467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69678ed-e742-4d55-b481-c34fcf2bc84a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:43.729467 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69678ed-e742-4d55-b481-c34fcf2bc84a None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:43.731388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 526/1064] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:43.736959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3d47-06e3-4820-9168-8e1344e8baa2 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:43.737378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3d47-06e3-4820-9168-8e1344e8baa2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:43.737473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d3d47-06e3-4820-9168-8e1344e8baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:43.756640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-ae0d3d47-06e3-4820-9168-8e1344e8baa2 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:43.757862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-ae0d3d47-06e3-4820-9168-8e1344e8baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:43.765439 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 539/1065] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:44.108376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69678ed-e742-4d55-b481-c34fcf2bc84a None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:44.119585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69678ed-e742-4d55-b481-c34fcf2bc84a None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:44.123686 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:44.124272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.124542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.124807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.133813 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:44.135234 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e8fc0-f6a8-439c-9b16-68664c48e9e5 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:44.144684 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 527/1066] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:46.502169 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b280a-5704-4e10-8866-285135ac7a26 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.502713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b280a-5704-4e10-8866-285135ac7a26 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.502713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373b280a-5704-4e10-8866-285135ac7a26 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.504021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 540/1067] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:46.509655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de40ba7-6106-4672-8119-5f892094d515 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.510060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de40ba7-6106-4672-8119-5f892094d515 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.510198 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de40ba7-6106-4672-8119-5f892094d515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.530573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-5de40ba7-6106-4672-8119-5f892094d515 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:46.532388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5de40ba7-6106-4672-8119-5f892094d515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:46.540217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 528/1068] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:46.891366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b280a-5704-4e10-8866-285135ac7a26 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:46.902639 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373b280a-5704-4e10-8866-285135ac7a26 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:46.906167 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:46.906756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.907043 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.907383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.916513 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:46.918646 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78133c65-d983-46e4-b10e-4976df9a11c2 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:46.928005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 541/1069] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:49.214018 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f19c5-1959-4f3b-83a1-ae84da32261a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:49.214587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f19c5-1959-4f3b-83a1-ae84da32261a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:49.214587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f19c5-1959-4f3b-83a1-ae84da32261a None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.215881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 529/1070] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:49.221168 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0065c7-738e-4f02-8b83-d2d9a32d9b18 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:49.221589 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0065c7-738e-4f02-8b83-d2d9a32d9b18 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:49.221768 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0065c7-738e-4f02-8b83-d2d9a32d9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.242088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-0f0065c7-738e-4f02-8b83-d2d9a32d9b18 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:49.243359 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-0f0065c7-738e-4f02-8b83-d2d9a32d9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:49.252116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 542/1071] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:49.595869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f19c5-1959-4f3b-83a1-ae84da32261a None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:49.607225 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f19c5-1959-4f3b-83a1-ae84da32261a None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:49.610749 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:49.611333 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:49.611607 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:49.611876 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.620814 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:49.622280 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c7ac8c-3f9d-4cc0-9ff2-5b11c0c5c253 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:49.631732 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 530/1072] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:49 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:51.940732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9ea-1c44-4791-8f4e-5a86709fdfb2 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.941304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9ea-1c44-4791-8f4e-5a86709fdfb2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.941304 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19da9ea-1c44-4791-8f4e-5a86709fdfb2 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.942693 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 543/1073] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:51.950736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912f90-cb44-49e3-b6f9-c86ecd1f2b5f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.951302 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912f90-cb44-49e3-b6f9-c86ecd1f2b5f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.951302 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39912f90-cb44-49e3-b6f9-c86ecd1f2b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.970581 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-39912f90-cb44-49e3-b6f9-c86ecd1f2b5f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:51.971786 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-39912f90-cb44-49e3-b6f9-c86ecd1f2b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:51.979760 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 531/1074] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:52.333972 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da9ea-1c44-4791-8f4e-5a86709fdfb2 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:52.339373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=64 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:52.345299 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19da9ea-1c44-4791-8f4e-5a86709fdfb2 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:52.348959 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:52.352621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.352621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.352621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.360409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:52.361958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e800e-f5cc-45a8-bd13-02e235e3d2a1 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.372213 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 544/1075] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:54.631918 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7add-d6fa-4364-b9a1-90e7d03aee5a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.632524 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7add-d6fa-4364-b9a1-90e7d03aee5a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.632524 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b7add-d6fa-4364-b9a1-90e7d03aee5a None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.633801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 532/1076] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:54.639581 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0055-9ece-484a-9099-4e9b4799ac36 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.640125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0055-9ece-484a-9099-4e9b4799ac36 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.640125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a0055-9ece-484a-9099-4e9b4799ac36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.660054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-732a0055-9ece-484a-9099-4e9b4799ac36 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:54.661248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-732a0055-9ece-484a-9099-4e9b4799ac36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:54.669280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 545/1077] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:55.011805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b7add-d6fa-4364-b9a1-90e7d03aee5a None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:55.018160 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=73 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:55.023762 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b7add-d6fa-4364-b9a1-90e7d03aee5a None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:55.027327 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:55.027938 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:55.028211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:55.028478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:55.037478 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:55.038976 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc18a91-695d-4c95-ac84-bb1191d7a433 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:55.049349 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 533/1078] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:57.397532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0ebd-ef87-4196-bfc0-d96b1c24a800 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:57.398163 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0ebd-ef87-4196-bfc0-d96b1c24a800 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:57.398163 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb0ebd-ef87-4196-bfc0-d96b1c24a800 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:57.399491 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 546/1079] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:57.405123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280567-cefe-4863-a467-b49ca9884213 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:57.405553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280567-cefe-4863-a467-b49ca9884213 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:57.405701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97280567-cefe-4863-a467-b49ca9884213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:57.424452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-97280567-cefe-4863-a467-b49ca9884213 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:57.425736 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-97280567-cefe-4863-a467-b49ca9884213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:57.434424 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 534/1080] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:06:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:57.785755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0ebd-ef87-4196-bfc0-d96b1c24a800 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:57.797038 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb0ebd-ef87-4196-bfc0-d96b1c24a800 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:57.800541 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:57.801122 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:57.801399 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:57.801697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:57.811154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:57.812579 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd34881-4e45-42e6-880f-ad1859b43a33 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:57.821815 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 547/1081] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:00.018186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90119a2-f857-49ee-8bb6-af13af7386fa None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.018781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90119a2-f857-49ee-8bb6-af13af7386fa None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.018781 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90119a2-f857-49ee-8bb6-af13af7386fa None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.020051 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 535/1082] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:00.025360 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b976-5537-496d-a8ea-4ae0eb88602e None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.026353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b976-5537-496d-a8ea-4ae0eb88602e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.026463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c1b976-5537-496d-a8ea-4ae0eb88602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.045239 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-a4c1b976-5537-496d-a8ea-4ae0eb88602e None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:00.047786 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-a4c1b976-5537-496d-a8ea-4ae0eb88602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.054357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 548/1083] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:00.389540 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90119a2-f857-49ee-8bb6-af13af7386fa None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.400365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90119a2-f857-49ee-8bb6-af13af7386fa None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.403889 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.404482 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.404757 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.405024 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.414220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.415640 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3abf2-ddea-42a1-af03-c3c291f985de service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.425298 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 536/1084] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:02.675185 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8f297-2613-4747-bc4c-dac883f32ad7 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:02.675831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8f297-2613-4747-bc4c-dac883f32ad7 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:02.675831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8f297-2613-4747-bc4c-dac883f32ad7 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:02.677035 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 549/1085] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:02.682753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2132-80f2-4a0f-96ce-17d69eceac89 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:02.684131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2132-80f2-4a0f-96ce-17d69eceac89 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:02.684131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd2132-80f2-4a0f-96ce-17d69eceac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:02.702452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-a4bd2132-80f2-4a0f-96ce-17d69eceac89 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:02.703633 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-a4bd2132-80f2-4a0f-96ce-17d69eceac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:02.711366 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 537/1086] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:07:02 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:03.051272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8f297-2613-4747-bc4c-dac883f32ad7 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:03.062474 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8f297-2613-4747-bc4c-dac883f32ad7 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:03.067143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:03.067738 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:03.068011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:03.068283 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:03.079721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:03.081671 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cc5ce-ee98-4a9d-a160-d32527890c4d service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:03.092191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 550/1087] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:03 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:12.697205 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=17 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:13.087027 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=23 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:27.381386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71189-cf67-442c-a852-74b43a1ed749 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.382036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71189-cf67-442c-a852-74b43a1ed749 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.382036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac71189-cf67-442c-a852-74b43a1ed749 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.383412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 538/1088] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:27.390918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e45-9806-4772-94f9-7bea617faadb None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.391529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e45-9806-4772-94f9-7bea617faadb None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.391529 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da4e45-9806-4772-94f9-7bea617faadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.411824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-99da4e45-9806-4772-94f9-7bea617faadb None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:27.413074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-99da4e45-9806-4772-94f9-7bea617faadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:27.422894 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 551/1089] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:27.782420 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9e0f-3daf-4103-b469-25565411bbbb None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.782700 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9e0f-3daf-4103-b469-25565411bbbb None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.782985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c9e0f-3daf-4103-b469-25565411bbbb None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.784360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 539/1090] 10.222.0.26 () {54 vars in 967 bytes} [Thu Aug 18 21:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:27.789429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88498-d14e-43c7-8712-48ef5b2c6eb1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.789755 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88498-d14e-43c7-8712-48ef5b2c6eb1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.790031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c88498-d14e-43c7-8712-48ef5b2c6eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.808981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-55c88498-d14e-43c7-8712-48ef5b2c6eb1 None None] MFA Rules not processed for user `67de97570521456da7cea34e7994dbef`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:27.810188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-55c88498-d14e-43c7-8712-48ef5b2c6eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:27.816771 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 552/1091] 10.222.0.26 () {58 vars in 1064 bytes} [Thu Aug 18 21:07:27 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:27.824461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c9e0f-3daf-4103-b469-25565411bbbb None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:27.834868 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c9e0f-3daf-4103-b469-25565411bbbb None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:27.838966 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67de97570521456da7cea34e7994dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:27.839565 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:27.839838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:27.840104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:27.848694 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:27.850143 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8457562-cb70-4506-8df6-7ae429e3e1b3 service glance] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:27.859640 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 540/1092] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:27 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:30.152274 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615712-bdb1-4c17-a480-cd7cbf20fb9d None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:30.152836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615712-bdb1-4c17-a480-cd7cbf20fb9d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:30.152836 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615712-bdb1-4c17-a480-cd7cbf20fb9d None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:30.154192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 553/1093] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:30.159574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad442b69-c95c-4a52-a4d9-5296dc7afda3 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:30.159999 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad442b69-c95c-4a52-a4d9-5296dc7afda3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:30.160102 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad442b69-c95c-4a52-a4d9-5296dc7afda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:30.179120 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-ad442b69-c95c-4a52-a4d9-5296dc7afda3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:30.180299 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-ad442b69-c95c-4a52-a4d9-5296dc7afda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:30.188400 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 541/1094] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:30 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:30.526675 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615712-bdb1-4c17-a480-cd7cbf20fb9d None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:30.539366 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615712-bdb1-4c17-a480-cd7cbf20fb9d None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:30.544504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:30.545109 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:30.545382 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:30.545680 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:30.546309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:30.548098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:07:30.548098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:07:30.548098 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:07:30.549232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bc219d-03a1-4cf1-bbbf-fe4db8ecb3e3 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:30.568073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 554/1095] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Aug 18 21:07:30 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:32.785858 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e29c8-48c7-4b27-8121-795b72c6a9b0 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:32.786435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e29c8-48c7-4b27-8121-795b72c6a9b0 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:32.786435 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e29c8-48c7-4b27-8121-795b72c6a9b0 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:32.787655 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 542/1096] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:32.795300 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16821-5595-443d-8837-884d2ce7bcb2 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:32.795831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16821-5595-443d-8837-884d2ce7bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:32.795831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a16821-5595-443d-8837-884d2ce7bcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:32.820533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-f4a16821-5595-443d-8837-884d2ce7bcb2 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:32.822276 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-f4a16821-5595-443d-8837-884d2ce7bcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:32.830183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 555/1097] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:33.193071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e29c8-48c7-4b27-8121-795b72c6a9b0 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.206667 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e29c8-48c7-4b27-8121-795b72c6a9b0 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.211486 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.212635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.212904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.213208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.221057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.222646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0614c2c5-d2a5-4fd1-aa7f-c02b6906135e service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.232778 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 543/1098] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:35.653734 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1b28-327c-4de2-821d-befbda49ee3a None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:35.654314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1b28-327c-4de2-821d-befbda49ee3a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:35.654314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1b28-327c-4de2-821d-befbda49ee3a None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:35.655517 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 556/1099] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:35.660769 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec181-5b1e-4c5b-80b8-2fe7b61a2572 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:35.661343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec181-5b1e-4c5b-80b8-2fe7b61a2572 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:35.661595 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcec181-5b1e-4c5b-80b8-2fe7b61a2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:35.682221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-9fcec181-5b1e-4c5b-80b8-2fe7b61a2572 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:35.683450 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-9fcec181-5b1e-4c5b-80b8-2fe7b61a2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:35.691268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 544/1100] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:35 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:36.034557 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1b28-327c-4de2-821d-befbda49ee3a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:36.045585 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1b28-327c-4de2-821d-befbda49ee3a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:36.049128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:36.049746 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:36.050024 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:36.050309 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:36.059387 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:36.060825 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465c5a3-0043-4fc2-9a68-7d9a6186bdfb service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:36.070195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 557/1101] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:36 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:38.324054 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d639d1e-7f69-4adf-b5cf-1456131ecd10 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.324638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d639d1e-7f69-4adf-b5cf-1456131ecd10 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.324638 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d639d1e-7f69-4adf-b5cf-1456131ecd10 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.325880 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 545/1102] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:38.331264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae798-4777-4981-8156-dd80e93082cc None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.332031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae798-4777-4981-8156-dd80e93082cc None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.332031 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ae798-4777-4981-8156-dd80e93082cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.352298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-767ae798-4777-4981-8156-dd80e93082cc None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:38.354193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-767ae798-4777-4981-8156-dd80e93082cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:38.362192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 558/1103] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:38 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:38.731772 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d639d1e-7f69-4adf-b5cf-1456131ecd10 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:38.742425 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d639d1e-7f69-4adf-b5cf-1456131ecd10 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:38.746617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:38.747221 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.747497 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.747768 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.756488 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:38.757960 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434cd6e-c8d3-4706-ac74-f4110ced3371 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:38.767119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 546/1104] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:38 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:41.060125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee3de-fcf7-4255-af45-f8be0a5a0536 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.060888 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee3de-fcf7-4255-af45-f8be0a5a0536 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.061190 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ee3de-fcf7-4255-af45-f8be0a5a0536 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.062598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 559/1105] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:41.068304 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3f6f-7211-473f-9987-3125accf395f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.068809 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3f6f-7211-473f-9987-3125accf395f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.068917 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3f6f-7211-473f-9987-3125accf395f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.093846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-654b3f6f-7211-473f-9987-3125accf395f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:41.093846 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-654b3f6f-7211-473f-9987-3125accf395f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:41.103826 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 547/1106] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:41 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:41.470550 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee3de-fcf7-4255-af45-f8be0a5a0536 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:41.484192 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ee3de-fcf7-4255-af45-f8be0a5a0536 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:41.488374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:41.488977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.489297 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.489517 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.499036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:41.500476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf7b23-d923-4719-ac7c-13d36bb63bea service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:41.511145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 560/1107] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:44.270939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e15fe-c6e1-435c-ab23-c3e1fee44efa None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.271530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e15fe-c6e1-435c-ab23-c3e1fee44efa None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.271530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e15fe-c6e1-435c-ab23-c3e1fee44efa None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.272795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 548/1108] 10.222.0.26 () {54 vars in 927 bytes} [Thu Aug 18 21:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:07:44.278145 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316622-56aa-4495-a045-e839aaa1407d None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.278600 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316622-56aa-4495-a045-e839aaa1407d None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.278721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8316622-56aa-4495-a045-e839aaa1407d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.299951 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e8316622-56aa-4495-a045-e839aaa1407d None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:44.301154 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e8316622-56aa-4495-a045-e839aaa1407d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.309868 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 561/1109] 10.222.0.26 () {58 vars in 1024 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:44.664629 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e15fe-c6e1-435c-ab23-c3e1fee44efa None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.675575 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e15fe-c6e1-435c-ab23-c3e1fee44efa None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.681325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.681325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.681325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.681325 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.689893 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.691311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0803347-c7a1-4dd4-a318-2f94beee0d62 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.701058 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 549/1110] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:54.293563 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=33 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:54.696445 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=33 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:10.319593 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838d60-4e68-453f-9385-bec81c69227a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.321480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838d60-4e68-453f-9385-bec81c69227a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.321480 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29838d60-4e68-453f-9385-bec81c69227a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.341931 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-29838d60-4e68-453f-9385-bec81c69227a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:10.343307 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-29838d60-4e68-453f-9385-bec81c69227a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:10.352414 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 562/1111] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:09:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:10.371440 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.372025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.372025 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.391985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:10.393218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:10.401071 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 550/1112] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:09:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:10.405857 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29838d60-4e68-453f-9385-bec81c69227a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.416728 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29838d60-4e68-453f-9385-bec81c69227a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.421543 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.422160 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.422438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.422710 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.423357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:09:10.423656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.424677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.424677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:09:10.424677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:09:10.425556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:10.438381 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 563/1113] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Aug 18 21:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:09:10.447692 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.456908 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11f814-a9a3-4430-bc5e-6546a19c8794 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.462436 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.463069 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.463343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.463611 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.464240 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.466100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.466100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:09:10.466100 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:09:10.467328 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:10.589051 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 551/1114] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Aug 18 21:09:10 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:09:10.593640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.603584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1502e-4170-4140-8574-a631cf68870b admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.661280 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.661908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.662181 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.662448 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.663696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.664709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.664709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:09:10.664709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:09:10.666261 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:10.773046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 564/1115] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 21:09:10 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:09:10.777346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.788411 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78748fb-bb33-4120-bfeb-f03b5b82de87 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.793373 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.794013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.794294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.794569 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.795215 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.796230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.796230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:09:10.796230 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:09:10.797122 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:10.811016 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 552/1116] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:09:10.815217 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.826105 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9de05f-d848-4f61-b088-9982833c082f admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.830830 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.831430 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.831711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.831983 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.832621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.833705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.833705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:09:10.833705 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:09:10.835087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfbfce-6e18-4787-aba5-ee3dc0e04028 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:10.852540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 565/1117] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:09:10.853726 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:10.864057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb355ec-70f4-42e0-a276-9ceacd91baf0 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:10.868930 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:10.869589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:10.870026 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:10.870301 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] PATH_INFO: `/v3/projects/6fcdc951a98a4ad786bd41953aece7ce/users/de232bca27624eccaf3ef49c3cf811d0/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:10.884829 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fcdc951a98a4ad786bd41953aece7ce, user_id=de232bca27624eccaf3ef49c3cf811d0, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:10.885887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:10.885887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:09:10.885887 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:09:10.887807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567eceec-0192-45ac-aa28-0a67ea9488e3 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.040653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 553/1118] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:09:10 2022] PUT /identity/v3/projects/6fcdc951a98a4ad786bd41953aece7ce/users/de232bca27624eccaf3ef49c3cf811d0/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:09:11.054393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887c76e-8327-4f8a-9172-dbab8706c8ea None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.054875 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887c76e-8327-4f8a-9172-dbab8706c8ea None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.055342 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887c76e-8327-4f8a-9172-dbab8706c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.086797 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-f887c76e-8327-4f8a-9172-dbab8706c8ea None None] MFA Rules not processed for user `de232bca27624eccaf3ef49c3cf811d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:11.087997 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-f887c76e-8327-4f8a-9172-dbab8706c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.151963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 566/1119] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:09:11 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:11.166257 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636e08-5258-4473-abc1-a45626248969 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.166546 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636e08-5258-4473-abc1-a45626248969 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.166818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05636e08-5258-4473-abc1-a45626248969 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.168144 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 554/1120] 10.222.0.26 () {54 vars in 964 bytes} [Thu Aug 18 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:11.172932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83129-33e4-40c7-8f97-15b697665e0b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.173209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83129-33e4-40c7-8f97-15b697665e0b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.173535 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83129-33e4-40c7-8f97-15b697665e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.193562 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-88d83129-33e4-40c7-8f97-15b697665e0b None None] MFA Rules not processed for user `e6c53c1c9519490f854adc67392e28d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:11.194933 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-88d83129-33e4-40c7-8f97-15b697665e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.238758 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:11.246617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 567/1121] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Aug 18 21:09:11 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:11.254423 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05636e08-5258-4473-abc1-a45626248969 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:11.264951 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05636e08-5258-4473-abc1-a45626248969 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:11.268709 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c53c1c9519490f854adc67392e28d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:11.269294 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.269571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.269869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.279152 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:11.280585 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.290571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 555/1122] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:11 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:09:11.328389 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e0bf9-347b-4784-ad00-c7919f05decf None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.331664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e0bf9-347b-4784-ad00-c7919f05decf None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.331664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e0bf9-347b-4784-ad00-c7919f05decf None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.331664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 568/1123] 10.222.0.26 () {52 vars in 830 bytes} [Thu Aug 18 21:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:11.333810 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:11.403105 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eedfa-f827-408b-aa67-dfbfb6401508 service cinder] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:11.407754 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:11.408376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.408646 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.408912 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] PATH_INFO: `/v3/users/de232bca27624eccaf3ef49c3cf811d0` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.410104 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=de232bca27624eccaf3ef49c3cf811d0)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:11.411228 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:11.411228 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:09:11.411228 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:09:11.412412 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.633697 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de232bca27624eccaf3ef49c3cf811d0'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:11.649119 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de232bca27624eccaf3ef49c3cf811d0'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:11.649949 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de232bca27624eccaf3ef49c3cf811d0'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:11.725442 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de232bca27624eccaf3ef49c3cf811d0'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:11.726020 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de232bca27624eccaf3ef49c3cf811d0'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:11.748878 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:11.756788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 556/1124] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Aug 18 21:09:11 2022] DELETE /identity/v3/users/de232bca27624eccaf3ef49c3cf811d0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:09:11.761709 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.762021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.762294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.797809 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:11.799009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.857142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 569/1125] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:09:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:11.866719 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:11.871923 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.924703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3a504-bf3f-4264-b462-c42362076ced admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:11.928297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:11.929538 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.934985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.934985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.939750 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:11.941203 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd60f0d-bc1d-4047-aa43-95ab170c70db service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.950584 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 557/1126] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:12.442416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:12.443913 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:12.459233 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f35196-2113-4666-8196-61b1d7d767c1 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:12.464813 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:12.467962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:12.467962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:12.467962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] PATH_INFO: `/v3/projects/6fcdc951a98a4ad786bd41953aece7ce` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:12.467962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fcdc951a98a4ad786bd41953aece7ce)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:12.468314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:09:12.468314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:09:12.468314 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:09:12.469781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:12.594751 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fcdc951a98a4ad786bd41953aece7ce', 'request_id': 'req-3b2a7d55-08d0-40bc-99f4-85d758a5a408'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.600805 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fcdc951a98a4ad786bd41953aece7ce', 'request_id': 'req-3b2a7d55-08d0-40bc-99f4-85d758a5a408'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.614602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fcdc951a98a4ad786bd41953aece7ce', 'request_id': 'req-3b2a7d55-08d0-40bc-99f4-85d758a5a408'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.702885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] The token cache is being invalidate because project 6fcdc951a98a4ad786bd41953aece7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:09:12.703083 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.703810 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-3b2a7d55-08d0-40bc-99f4-85d758a5a408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:09:12.705393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 570/1127] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Aug 18 21:09:12 2022] DELETE /identity/v3/projects/6fcdc951a98a4ad786bd41953aece7ce => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:09:21.946372 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:22.699408 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:40.818787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:40.819357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:40.819357 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:40.820592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 558/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:40.825393 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd590a2-2d6b-4749-9055-5d87478fc596 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:40.826374 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd590a2-2d6b-4749-9055-5d87478fc596 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:40.826539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd590a2-2d6b-4749-9055-5d87478fc596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:40.847955 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4fd590a2-2d6b-4749-9055-5d87478fc596 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:40.849157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4fd590a2-2d6b-4749-9055-5d87478fc596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:40.909820 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 571/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:10:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:41.070208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:41.071849 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:41.145569 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835032f-e163-41a7-a614-fdcd70bb7529 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:41.150929 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:41.151773 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:41.152056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:41.152335 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:41.168038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:41.169695 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbf3f3-7e58-4e34-ad05-7df6dac1a11c service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:41.179162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 559/1130] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:41 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:42.061851 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bdb6-7e71-4fab-8846-b2648fd77a76 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:42.062471 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bdb6-7e71-4fab-8846-b2648fd77a76 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:42.062471 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7bdb6-7e71-4fab-8846-b2648fd77a76 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:42.063731 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 572/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:42.069175 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed3b3-da1b-4e57-8196-351731015682 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:42.069767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed3b3-da1b-4e57-8196-351731015682 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:42.069767 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfed3b3-da1b-4e57-8196-351731015682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:42.090379 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-3dfed3b3-da1b-4e57-8196-351731015682 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:42.092135 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-3dfed3b3-da1b-4e57-8196-351731015682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:42.100801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 560/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:10:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:42.264247 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7bdb6-7e71-4fab-8846-b2648fd77a76 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:42.277854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7bdb6-7e71-4fab-8846-b2648fd77a76 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:42.283536 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:42.284180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:42.284507 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:42.284776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:42.293799 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:42.295411 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11b318-ac67-4467-8cac-eb396b85872d service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:42.305337 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 573/1133] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:46.781075 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afa62-9ec8-4947-84b4-e8905ea8cc3a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:46.781675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afa62-9ec8-4947-84b4-e8905ea8cc3a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:46.781919 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1afa62-9ec8-4947-84b4-e8905ea8cc3a None None] PATH_INFO: `/v3` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:46.783036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 561/1134] 10.222.0.57 () {54 vars in 925 bytes} [Thu Aug 18 21:10:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:10:46.789232 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12423-aab5-4b98-9cbd-149a251493df None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:46.789678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12423-aab5-4b98-9cbd-149a251493df None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:46.789831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa12423-aab5-4b98-9cbd-149a251493df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:46.821341 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-1aa12423-aab5-4b98-9cbd-149a251493df None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:46.822658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-1aa12423-aab5-4b98-9cbd-149a251493df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:46.886012 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 574/1135] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Aug 18 21:10:46 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:52.085254 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=35 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:53.580788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744413ef-d5ab-4237-a427-b86b13131a8b None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:53.581464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744413ef-d5ab-4237-a427-b86b13131a8b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:53.581464 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744413ef-d5ab-4237-a427-b86b13131a8b None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:53.582722 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 562/1136] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:53.588080 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7caa12-b8c7-4717-9a39-5de0ffb306ae None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:53.588504 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7caa12-b8c7-4717-9a39-5de0ffb306ae None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:53.588641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7caa12-b8c7-4717-9a39-5de0ffb306ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:53.609073 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-3b7caa12-b8c7-4717-9a39-5de0ffb306ae None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:53.610305 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-3b7caa12-b8c7-4717-9a39-5de0ffb306ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:53.618364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 575/1137] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:10:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:53.775396 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744413ef-d5ab-4237-a427-b86b13131a8b None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:53.789402 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744413ef-d5ab-4237-a427-b86b13131a8b None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:53.794810 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:53.795407 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:53.795680 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:53.795947 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:53.804399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:53.806012 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f9bb2-b02d-404a-b75c-521a76884200 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:53.816057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 563/1138] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:54.646660 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ccf8-5fc8-4c65-a2fe-05987c727702 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:54.647263 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ccf8-5fc8-4c65-a2fe-05987c727702 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:54.647263 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8ccf8-5fc8-4c65-a2fe-05987c727702 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:54.648559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 576/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:54.653582 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2e2f-90c7-4e6b-9f6b-3627f8d5410c None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:54.654061 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2e2f-90c7-4e6b-9f6b-3627f8d5410c None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:54.654180 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c2e2f-90c7-4e6b-9f6b-3627f8d5410c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:54.674983 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-2a5c2e2f-90c7-4e6b-9f6b-3627f8d5410c None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:54.676224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-2a5c2e2f-90c7-4e6b-9f6b-3627f8d5410c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:54.684168 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 564/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:10:54 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:54.841522 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8ccf8-5fc8-4c65-a2fe-05987c727702 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:54.855086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8ccf8-5fc8-4c65-a2fe-05987c727702 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:54.860515 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:54.861095 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:54.861369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:54.861729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:54.869640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:54.871202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3c628-83e9-4b2f-8cea-383dd2791594 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:54.880427 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 577/1141] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:54 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:56.433683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a767-3a39-4c13-bd55-cb5a24ccc455 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:56.434253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a767-3a39-4c13-bd55-cb5a24ccc455 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:56.434253 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515a767-3a39-4c13-bd55-cb5a24ccc455 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:56.436136 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 565/1142] 10.222.0.26 () {54 vars in 961 bytes} [Thu Aug 18 21:10:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:56.441532 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef247c5-d6dc-430c-ac64-4b3de14b27bc None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:56.442055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef247c5-d6dc-430c-ac64-4b3de14b27bc None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:56.442180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef247c5-d6dc-430c-ac64-4b3de14b27bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:56.464176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-6ef247c5-d6dc-430c-ac64-4b3de14b27bc None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:56.464176 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-6ef247c5-d6dc-430c-ac64-4b3de14b27bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:56.472136 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 578/1143] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Aug 18 21:10:56 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:56.479571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a767-3a39-4c13-bd55-cb5a24ccc455 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:56.493543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515a767-3a39-4c13-bd55-cb5a24ccc455 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:56.499220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:56.499812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:56.500086 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:56.500624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:56.509001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:56.510591 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440360b9-c1b5-4775-9bdf-78b8b92bc527 service placement] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:56.520235 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 566/1144] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:06.132500 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d7de-4265-4a87-98c9-a4013a495f43 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:06.133121 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d7de-4265-4a87-98c9-a4013a495f43 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:06.133287 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed5d7de-4265-4a87-98c9-a4013a495f43 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:06.135378 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 579/1145] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:06.140496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d269-6fc7-458a-8405-18aa38f6f635 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:06.140962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d269-6fc7-458a-8405-18aa38f6f635 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:06.141076 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2d269-6fc7-458a-8405-18aa38f6f635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:06.160364 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-45e2d269-6fc7-458a-8405-18aa38f6f635 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:06.161542 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-45e2d269-6fc7-458a-8405-18aa38f6f635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:06.170030 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 567/1146] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:06.331383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d7de-4265-4a87-98c9-a4013a495f43 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:06.338783 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=80 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:06.344944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed5d7de-4265-4a87-98c9-a4013a495f43 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:06.351421 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:06.352310 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:06.354790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:06.354790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:06.362776 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:06.364375 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b021cf-9b9f-4e2f-aee8-47c081e6fecd service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:06.374676 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 580/1147] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:07.228082 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf537f1-9bcf-4d4e-9277-816fe7c9f903 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:07.228701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf537f1-9bcf-4d4e-9277-816fe7c9f903 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:07.228701 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf537f1-9bcf-4d4e-9277-816fe7c9f903 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:07.229990 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 568/1148] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:07.235754 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f70fb-7061-4d50-86ab-7c757042d3a0 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:07.236222 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f70fb-7061-4d50-86ab-7c757042d3a0 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:07.236351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f70fb-7061-4d50-86ab-7c757042d3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:07.256335 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-c16f70fb-7061-4d50-86ab-7c757042d3a0 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:07.257602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-c16f70fb-7061-4d50-86ab-7c757042d3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:07.265917 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 581/1149] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:11:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:07.424992 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf537f1-9bcf-4d4e-9277-816fe7c9f903 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:07.439181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf537f1-9bcf-4d4e-9277-816fe7c9f903 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:07.444360 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:07.444985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:07.445260 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:07.445530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:07.455399 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:07.457019 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6d06e-ce0a-4828-8cab-bbb7347426d3 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:07.467670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 569/1150] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:12.279840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:12.280416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:12.280416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:12.281748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 582/1151] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:12.287031 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ab43-c9fd-447f-ba75-26b276d58aac None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:12.287444 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ab43-c9fd-447f-ba75-26b276d58aac None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:12.287571 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650ab43-c9fd-447f-ba75-26b276d58aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:12.309043 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-c650ab43-c9fd-447f-ba75-26b276d58aac None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:12.310283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-c650ab43-c9fd-447f-ba75-26b276d58aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:12.318552 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 570/1152] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:12 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:12.669153 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:12.671010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:12.730962 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96eb86-dbe8-44d8-b8e1-a1acad45dcc6 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:12.734510 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:12.735111 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:12.735383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:12.735656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:12.745539 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:12.747052 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01eccb-ab03-4bfc-8ccc-8945f7aaf431 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:12.757733 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 583/1153] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:12 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:14.973562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85da1-db67-42f9-b53a-5f1e8372a32a None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:14.974129 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85da1-db67-42f9-b53a-5f1e8372a32a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:14.974249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af85da1-db67-42f9-b53a-5f1e8372a32a None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:14.975559 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 571/1154] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:14.980704 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dedc9c-3cd3-4d73-8c63-373a6f4ff4c3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:14.981128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dedc9c-3cd3-4d73-8c63-373a6f4ff4c3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:14.981253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dedc9c-3cd3-4d73-8c63-373a6f4ff4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:15.001078 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-43dedc9c-3cd3-4d73-8c63-373a6f4ff4c3 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:15.002317 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-43dedc9c-3cd3-4d73-8c63-373a6f4ff4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:15.010183 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 584/1155] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:15.351268 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af85da1-db67-42f9-b53a-5f1e8372a32a None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:15.362483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af85da1-db67-42f9-b53a-5f1e8372a32a None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:15.366009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:15.366607 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:15.367007 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:15.367311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:15.376332 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:15.377834 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f2f36-eef6-4211-87a7-861f5551aa1c service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:15.387140 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 572/1156] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:19.332197 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:19.332807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:19.332807 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:19.334101 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 585/1157] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:19.339208 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2f67-4614-42d3-a78c-f3bcbbe1232a None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:19.339617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2f67-4614-42d3-a78c-f3bcbbe1232a None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:19.339795 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b2f67-4614-42d3-a78c-f3bcbbe1232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:19.358981 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-0f2b2f67-4614-42d3-a78c-f3bcbbe1232a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:19.360213 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-0f2b2f67-4614-42d3-a78c-f3bcbbe1232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:19.367962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 573/1158] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:19.952425 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:19.954118 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:20.019548 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334cd3-15d9-4513-b184-6ef7a1acc064 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:20.023063 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c53c1c9519490f854adc67392e28d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:20.023652 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:20.023932 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:20.024204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:20.033834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:20.035397 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9d18bd-523c-4639-a83a-52fc786dba29 service cinder] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:20.045377 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 586/1159] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:22.288247 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:22.288861 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:22.288861 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:22.290170 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 574/1160] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:11:22.295816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cac5-d29e-4062-85f4-c1690d8683ee None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:22.296241 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cac5-d29e-4062-85f4-c1690d8683ee None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:22.296357 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b8cac5-d29e-4062-85f4-c1690d8683ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:22.315178 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-28b8cac5-d29e-4062-85f4-c1690d8683ee None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:22.316364 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-28b8cac5-d29e-4062-85f4-c1690d8683ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:22.323978 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 587/1161] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:11:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:22.901511 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:22.903309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:22.911097 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=37 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:22.917074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c5f42-41b6-446b-8b59-689866818579 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:22.921157 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c53c1c9519490f854adc67392e28d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:22.921776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:22.922055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:22.922326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:22.931141 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:22.935558 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5217cf7-03a2-49b2-9f72-fe8ce57afa10 service cinder] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:22.942371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 575/1162] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:32.310055 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=66 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:32.947650 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=5 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:39.790837 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7ef1-8814-473c-92ee-306c0354c138 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.791468 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7ef1-8814-473c-92ee-306c0354c138 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.791468 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd7ef1-8814-473c-92ee-306c0354c138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.794264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e22a-da2d-498a-879e-59e909ee0449 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.794728 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e22a-da2d-498a-879e-59e909ee0449 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.794930 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36e22a-da2d-498a-879e-59e909ee0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.811347 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e2cd7ef1-8814-473c-92ee-306c0354c138 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:39.812556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e2cd7ef1-8814-473c-92ee-306c0354c138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:39.814009 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-da36e22a-da2d-498a-879e-59e909ee0449 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:39.815182 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-da36e22a-da2d-498a-879e-59e909ee0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:39.820373 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 588/1163] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:39.823005 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 576/1164] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:39.828544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.828818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.829087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.831057 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.831340 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.831615 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.849502 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:39.850794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:39.850942 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:39.852069 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:39.860103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 589/1165] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:39.860939 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 577/1166] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:39.865035 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:39.865188 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:39.874193 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f20d85-00a1-424a-b1a4-6b99bb9718cb None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:39.874370 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e5699c-9627-41db-b109-e20aea77a5f1 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:39.878845 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:39.879038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:39.879431 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.879631 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.879729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.879910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.880014 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.880183 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.880572 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:39.880818 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88585) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:39.880915 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:39.881121 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:39.882151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:12:39.882151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:12:39.882151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:12:39.882494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:39.883127 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:39.894036 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 590/1167] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:39.894624 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 578/1168] 10.222.0.26 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:39.901909 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:39.902224 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:39.912617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a69784-3569-483e-a82c-3065c0070ce1 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:39.912937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcc669-74bb-4c5b-ba0b-160e1b1aee6c admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:39.917111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:39.917498 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:39.917723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.918001 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.918138 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:39.918273 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.918416 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:39.918634 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:39.918881 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:39.919250 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:39.920253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:12:39.920253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:12:39.920253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:12:39.920774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:39.921429 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.013236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 579/1169] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:40.017452 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.066865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 591/1170] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:39 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:40.071081 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.078703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e1d1c-61dc-42d3-8f12-cc7a22e040d5 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.135842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b2fc92-fd3c-45d8-b65a-d2baa158abaf admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.136093 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.136688 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.136969 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.137251 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.137902 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.138909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: WARNING py.warnings [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:12:40.138909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: warnings.warn(msg) Aug 18 21:12:40.138909 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: Aug 18 21:12:40.140123 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.141088 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.141723 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.142004 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.142275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] PATH_INFO: `/v3/users` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.142894 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.144862 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.248410 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 580/1171] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:40 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:40.252417 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.262027 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388e2ae-e403-406b-b03d-6008c55e2dfc admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.267379 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.267993 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.268264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.268569 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.269174 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.269938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 592/1172] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:40 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:40.270839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.274201 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.282154 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 581/1173] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:40.284724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4f846-af59-49de-a475-9c183bfe4209 admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.286297 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.289831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.295542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.295542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.295542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.295542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.295542 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.296056 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f71dc-5959-4bc7-ab73-02f04c07cf0c admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.300785 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.301383 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.301687 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.301963 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.302592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.303695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 593/1174] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:40.304186 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.307695 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.317752 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155eb1a-ccaf-4ed4-995f-493a4402eb1c admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.323424 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.323588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 582/1175] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:40.323712 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.323950 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.324050 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.324640 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.326441 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.327283 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.337528 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecee5f-9f43-45f5-a6ce-cd753a33a2e3 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.340010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 594/1176] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:40.342413 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.344367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.344367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.344367 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] PATH_INFO: `/v3/projects/91a161471cfb475693948d252c2766d4/users/769ff5837a9d4a6b8d8a7aa2751c1114/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.347739 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.359202 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee45d-114b-43bf-b7c6-07ef7133c53c admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.363271 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a161471cfb475693948d252c2766d4, user_id=769ff5837a9d4a6b8d8a7aa2751c1114, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.363906 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.364556 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] REQUEST_METHOD: `PUT` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.364834 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.365103 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] PATH_INFO: `/v3/projects/7cc736229d024d57be92f66ce0c3ec85/users/1a2765e2c74e4d34b5208fb3d3f11d42/roles/2ee117d96f4b4c519e43c0e588fa600c` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.366448 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01fe0a-7175-405f-9b6b-424f9577b815 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.380664 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc736229d024d57be92f66ce0c3ec85, user_id=1a2765e2c74e4d34b5208fb3d3f11d42, role_id=2ee117d96f4b4c519e43c0e588fa600c)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.387248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: WARNING py.warnings [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:12:40.387248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: warnings.warn(msg) Aug 18 21:12:40.387248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: Aug 18 21:12:40.387248 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adbbd47-bd7e-4238-a4fe-b4851a067033 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.440910 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 583/1177] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:40 2022] PUT /identity/v3/projects/91a161471cfb475693948d252c2766d4/users/769ff5837a9d4a6b8d8a7aa2751c1114/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:40.445921 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.446211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.446485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.456161 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:40.466944 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:40.468162 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:40.499353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 595/1178] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:40 2022] PUT /identity/v3/projects/7cc736229d024d57be92f66ce0c3ec85/users/1a2765e2c74e4d34b5208fb3d3f11d42/roles/2ee117d96f4b4c519e43c0e588fa600c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:40.505059 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.505344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.505644 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.524957 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] MFA Rules not processed for user `4b130916f4b143099f2974e99dac365a`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:40.526479 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:40.529577 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 584/1179] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:40.539779 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.579974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:40.591398 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 596/1180] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:40 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:40.596459 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75aa35-c08c-4ee5-97e6-4b8b0da9212f None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.601139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:40.650394 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.654194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.654194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.654194 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.662037 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad62c6-481c-40d6-9b0c-cd8ef441b23a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:40.662274 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.663733 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1604383-f90a-4688-935c-50e461c13f0b service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.665715 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:40.666383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:40.666601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:40.666872 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:40.674453 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 585/1181] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:40.677351 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:40.678858 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:40.688948 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 597/1182] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:40 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:47.323496 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:47.326815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:47.326815 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:47.380181 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] MFA Rules not processed for user `769ff5837a9d4a6b8d8a7aa2751c1114`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:47.382218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:47.465036 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:47.490937 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 586/1183] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:47 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:47.492915 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:47.503087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a058acb4-11bd-40a3-8ef2-38aef51ffa54 service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:47.508142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:47.508971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:47.509074 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:47.509272 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:47.509943 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:47.512089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:47.605658 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 598/1184] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:47 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:47.609387 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:47.630877 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd993956-45b0-4514-9834-b3a31665d1ee None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:47.739421 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:47.740118 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:47.741642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:47.741642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:47.741642 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:47.743867 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:47.891039 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 587/1185] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:47 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:47.893099 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:47.929907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7907b-c602-4733-abdf-b27b1ab8a40b admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:47.932446 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:47.933259 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:47.933719 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:47.934139 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:47.934947 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:47.936764 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12722d7f-df9a-4992-9504-eac035fe2def admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:47.974255 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 599/1186] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:47.978494 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:47.995083 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2efde2-0002-4570-bd5f-1cf0c19a8407 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.000959 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.002841 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.003414 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.004463 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] PATH_INFO: `/v3/projects/2ebff5dd31d64609854177aebf72a5b9/users/9823075240a8425f871e1a3a877e2240/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.047583 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebff5dd31d64609854177aebf72a5b9, user_id=9823075240a8425f871e1a3a877e2240, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.054980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.131195 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.131686 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.132207 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.145487 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 588/1187] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:47 2022] PUT /identity/v3/projects/2ebff5dd31d64609854177aebf72a5b9/users/9823075240a8425f871e1a3a877e2240/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:48.150060 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.186919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] MFA Rules not processed for user `1a2765e2c74e4d34b5208fb3d3f11d42`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:48.196935 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:48.318343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b00cd1-acfb-4d87-8e52-66f6a8d7c898 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.325675 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.326977 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.327492 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.327981 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] PATH_INFO: `/v3/roles` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.328842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.331310 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.338404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 600/1188] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:48 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:48.343543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 589/1189] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:48.347203 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.348376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.364806 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28679a94-3eec-4b58-bf8c-292856e21078 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.369974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a6288-615d-4fea-8bf3-9d68d42a2f94 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.370530 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.371217 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.371483 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.371807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] PATH_INFO: `/v3/projects/2ebff5dd31d64609854177aebf72a5b9/users/9823075240a8425f871e1a3a877e2240/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.374362 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebff5dd31d64609854177aebf72a5b9, user_id=9823075240a8425f871e1a3a877e2240, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.378052 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.380865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.381896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.383960 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.384775 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.385678 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.389380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.389574 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 590/1190] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:48 2022] PUT /identity/v3/projects/2ebff5dd31d64609854177aebf72a5b9/users/9823075240a8425f871e1a3a877e2240/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:48.490459 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 601/1191] 10.222.0.26 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:48 2022] POST /identity/v3/projects => generated 379 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:48.494790 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.565131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:48.620391 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6160720-b8fa-4c7a-a226-280885dac4e8 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.701871 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.702666 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.702956 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.703223 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] PATH_INFO: `/v3/users` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.703872 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.706034 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.808314 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 591/1192] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:48 2022] POST /identity/v3/users => generated 296 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:48.812404 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.824200 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a633d156-d366-4059-ac6e-3d1f1ba10f7d admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.828990 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.831165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.831165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.831165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.831432 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.833002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.843743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 602/1193] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:48.849787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.861748 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ead76-573b-4589-b1fc-f5ac09df079e admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.866676 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:48.871232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:48.871232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:48.871232 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] PATH_INFO: `/v3/projects/60398bb3d31f46c3b91753a46f0948fc/users/56a14ebd02f64ed199b6946b5043c1fe/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:48.883899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60398bb3d31f46c3b91753a46f0948fc, user_id=56a14ebd02f64ed199b6946b5043c1fe, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:48.886628 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:48.945725 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 592/1194] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:48 2022] PUT /identity/v3/projects/60398bb3d31f46c3b91753a46f0948fc/users/56a14ebd02f64ed199b6946b5043c1fe/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:48.949735 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:48.964596 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac3bdd-bc8b-448a-afc0-7c86a984b6ed admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:48.991494 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:49.052677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:49.058509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:49.058509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:49.058509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] PATH_INFO: `/v3/roles` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:49.058509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:49.058509 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e304ec0-a70b-4031-abc2-1fc9bee2f892 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:49.073150 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 603/1195] 10.222.0.26 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:49.076857 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:49.088460 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a525c-40ce-46d7-9ec2-d73f17f95c98 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:49.093211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:49.093928 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] REQUEST_METHOD: `PUT` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:49.094211 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:49.094484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] PATH_INFO: `/v3/projects/60398bb3d31f46c3b91753a46f0948fc/users/56a14ebd02f64ed199b6946b5043c1fe/roles/77fecc16fb304d4a91278ad7f4674f4e` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:49.096593 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60398bb3d31f46c3b91753a46f0948fc, user_id=56a14ebd02f64ed199b6946b5043c1fe, role_id=77fecc16fb304d4a91278ad7f4674f4e)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:49.103414 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:49.116844 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 593/1196] 10.222.0.26 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:49 2022] PUT /identity/v3/projects/60398bb3d31f46c3b91753a46f0948fc/users/56a14ebd02f64ed199b6946b5043c1fe/roles/77fecc16fb304d4a91278ad7f4674f4e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:56.133503 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871bce9-974b-4915-85b6-22fb6c3e9ab2 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:56.134180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871bce9-974b-4915-85b6-22fb6c3e9ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:56.134180 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871bce9-974b-4915-85b6-22fb6c3e9ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:56.171800 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5871bce9-974b-4915-85b6-22fb6c3e9ab2 None None] MFA Rules not processed for user `9823075240a8425f871e1a3a877e2240`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:56.176870 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5871bce9-974b-4915-85b6-22fb6c3e9ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:56.258086 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 604/1197] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:56 2022] POST /identity/v3/auth/tokens => generated 2889 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:56.284307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:56.288415 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:56.358105 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26419b0b-a4a0-4506-9463-a880f657f50f admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:56.362438 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67de97570521456da7cea34e7994dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:56.363038 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:56.363535 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:56.363819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:56.447519 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:56.452579 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:56.454854 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:56.468013 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 594/1198] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:56 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:57.147005 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ac07-6e73-4ffc-a666-b626216dba92 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:57.147597 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ac07-6e73-4ffc-a666-b626216dba92 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:57.147934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681ac07-6e73-4ffc-a666-b626216dba92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:57.212700 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-c681ac07-6e73-4ffc-a666-b626216dba92 None None] MFA Rules not processed for user `56a14ebd02f64ed199b6946b5043c1fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:57.213970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-c681ac07-6e73-4ffc-a666-b626216dba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:57.330246 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 605/1199] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:12:57 2022] POST /identity/v3/auth/tokens => generated 2883 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:57.343903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:57.356315 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe595b-f87e-47c3-b872-a648752dc6db service glance] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:57.361105 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67de97570521456da7cea34e7994dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:57.361833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:57.362189 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:57.362543 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:57.436226 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:57.437806 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d3df6-a1b5-414c-ac87-46693d1982fd service glance] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:57.448601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 595/1200] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:57 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:07.325505 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=87 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:07.400660 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1253-bac4-4e5f-8427-a8355b4022ca None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.400991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1253-bac4-4e5f-8427-a8355b4022ca None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.401264 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c1253-bac4-4e5f-8427-a8355b4022ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.421721 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-0b0c1253-bac4-4e5f-8427-a8355b4022ca None None] MFA Rules not processed for user `769ff5837a9d4a6b8d8a7aa2751c1114`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:07.423584 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-0b0c1253-bac4-4e5f-8427-a8355b4022ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:07.430981 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 606/1201] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:13:07 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:07.443985 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=31 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:07.729365 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17425d15-a271-473d-bc2e-ff76e5bde1e3 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.730070 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17425d15-a271-473d-bc2e-ff76e5bde1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.730617 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17425d15-a271-473d-bc2e-ff76e5bde1e3 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.732636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 596/1202] 10.222.0.26 () {54 vars in 962 bytes} [Thu Aug 18 21:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:07.740174 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845d8ef-a913-468d-aa14-456ad904c0bd None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.740569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845d8ef-a913-468d-aa14-456ad904c0bd None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.741046 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845d8ef-a913-468d-aa14-456ad904c0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.763936 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4845d8ef-a913-468d-aa14-456ad904c0bd None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:07.765204 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4845d8ef-a913-468d-aa14-456ad904c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:07.852353 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 607/1203] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Aug 18 21:13:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:07.859457 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.863557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.863557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.863557 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 597/1204] 10.222.0.26 () {54 vars in 912 bytes} [Thu Aug 18 21:13:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:07.868790 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea942f99-56f8-4069-8620-955f3a5e73b6 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.869072 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea942f99-56f8-4069-8620-955f3a5e73b6 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.869342 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea942f99-56f8-4069-8620-955f3a5e73b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.891687 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-ea942f99-56f8-4069-8620-955f3a5e73b6 None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:07.892933 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-ea942f99-56f8-4069-8620-955f3a5e73b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:07.901677 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 608/1205] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:07 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:07.914099 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:07.915875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:07.929479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8adda37-a7a9-438f-b1d3-47ad53c512c6 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:07.933286 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67de97570521456da7cea34e7994dbef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:07.934053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:07.934343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:07.934612 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:07.946006 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:07.947489 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353eebd8-7690-4f15-8ead-956ef8b1f2c8 service glance] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:07.961263 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 598/1206] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:07 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:08.444899 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:08.445476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:08.445476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:08.446854 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 609/1207] 10.222.0.26 () {54 vars in 912 bytes} [Thu Aug 18 21:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:08.452578 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18856e4-3b74-4c37-9829-277e487edd1d None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:08.453369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18856e4-3b74-4c37-9829-277e487edd1d None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:08.453369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18856e4-3b74-4c37-9829-277e487edd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:08.475545 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-d18856e4-3b74-4c37-9829-277e487edd1d None None] MFA Rules not processed for user `7c02350215a147e7aeeeae512c99a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:08.476842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-d18856e4-3b74-4c37-9829-277e487edd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:08.540086 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 599/1208] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:08 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:08.552220 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:08.554047 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:08.568418 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef7dfd3-8731-4063-840c-d9a91278bb2a None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:08.572338 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:08.572885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:08.573161 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:08.573433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:08.581956 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:08.583435 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8fca0-07ad-44a3-864d-7c66b49428ce service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:08.592656 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 610/1209] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:08 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:09.134994 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131157-fe78-4e45-add1-b5346163e989 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.135287 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131157-fe78-4e45-add1-b5346163e989 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.135619 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1131157-fe78-4e45-add1-b5346163e989 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.137338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 600/1210] 10.222.0.26 () {54 vars in 962 bytes} [Thu Aug 18 21:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:09.144447 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b4ec-4a8b-40e2-9562-d676c890af1b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.145278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b4ec-4a8b-40e2-9562-d676c890af1b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.145907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423b4ec-4a8b-40e2-9562-d676c890af1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.154636 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a184-4e4e-49bd-a556-25b2097b6f3b None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.155149 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a184-4e4e-49bd-a556-25b2097b6f3b None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.155601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5a184-4e4e-49bd-a556-25b2097b6f3b None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.158275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 601/1211] 10.222.0.26 () {54 vars in 961 bytes} [Thu Aug 18 21:13:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:13:09.163562 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.163993 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.164338 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.171873 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-4423b4ec-4a8b-40e2-9562-d676c890af1b None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:09.173723 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-4423b4ec-4a8b-40e2-9562-d676c890af1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:09.182859 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 611/1212] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Aug 18 21:13:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:09.186789 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:09.188772 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:09.190028 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb48b-cc73-49b5-9547-ddd738f6772f None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.190380 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb48b-cc73-49b5-9547-ddd738f6772f None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.190661 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abeb48b-cc73-49b5-9547-ddd738f6772f None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.192226 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 612/1213] 10.222.0.26 () {54 vars in 912 bytes} [Thu Aug 18 21:13:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:09.198553 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.198831 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.199663 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.223140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:09.225051 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:09.234285 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 613/1214] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Aug 18 21:13:09 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:09.250410 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:09.264438 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e790e85-10e0-438d-a1c0-8fce2779f68b None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:09.268823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:09.269518 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.269841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.270116 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.274454 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 602/1215] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Aug 18 21:13:09 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:09.281838 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:09.287455 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:09.288908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bef6b-be87-4fc6-a533-7926d708fc0e service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:09.292553 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bec6c3-afb5-4836-81eb-4ad6facffcae None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:09.299190 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:09.299850 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 614/1216] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:09 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:09.299978 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:09.300300 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:09.300683 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:09.302580 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:09.315623 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:09.317226 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:09.329388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 603/1217] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:09 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:19.294731 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=53 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:19.324237 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=64 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:23.412336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e39935-0b74-453a-982d-c104d9a29395 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:23.412991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e39935-0b74-453a-982d-c104d9a29395 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:23.412991 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e39935-0b74-453a-982d-c104d9a29395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:23.436275 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-b6e39935-0b74-453a-982d-c104d9a29395 None None] MFA Rules not processed for user `7c02350215a147e7aeeeae512c99a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:23.438146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-b6e39935-0b74-453a-982d-c104d9a29395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:23.444908 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 615/1218] 10.222.0.57 () {58 vars in 1015 bytes} [Thu Aug 18 21:13:23 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:23.456622 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:23.466601 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed3c80-7ed7-4739-a24d-bbf6025a8c86 service placement] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:23.470703 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:23.471307 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:23.471592 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:23.471851 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:23.479842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:23.481346 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d261e-71e4-463a-9507-606690f3507d service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:23.490053 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 604/1219] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:23 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:24.650140 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ddba-9aa7-4a74-a302-7598cfae5736 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:24.650749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ddba-9aa7-4a74-a302-7598cfae5736 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:24.650749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486ddba-9aa7-4a74-a302-7598cfae5736 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:24.652146 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 616/1220] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:24.671696 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b629-fc6a-4e74-ac6c-a96877772c9e None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:24.672326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b629-fc6a-4e74-ac6c-a96877772c9e None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:24.672326 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6b629-fc6a-4e74-ac6c-a96877772c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:24.695153 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-bca6b629-fc6a-4e74-ac6c-a96877772c9e None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:24.697074 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-bca6b629-fc6a-4e74-ac6c-a96877772c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:24.709829 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 605/1221] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:13:24 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:24.724278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ddba-9aa7-4a74-a302-7598cfae5736 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:24.742128 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486ddba-9aa7-4a74-a302-7598cfae5736 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:24.749841 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:24.750737 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:24.751125 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:24.751725 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:24.771344 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:24.773559 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5a3fb-fde7-4d96-9adc-62b87d4f61e4 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:24.786896 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 617/1222] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:24 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:33.814343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec803-4e5a-4c8c-a63d-71241caab628 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.815093 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec803-4e5a-4c8c-a63d-71241caab628 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.815093 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ec803-4e5a-4c8c-a63d-71241caab628 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.816451 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 606/1223] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:33.823756 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978931d6-06a3-4518-9310-23211556513c None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.824327 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978931d6-06a3-4518-9310-23211556513c None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.824449 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978931d6-06a3-4518-9310-23211556513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.846254 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-978931d6-06a3-4518-9310-23211556513c None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:33.849833 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-978931d6-06a3-4518-9310-23211556513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:33.856575 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 618/1224] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:13:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:33.872204 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec803-4e5a-4c8c-a63d-71241caab628 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:33.887272 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ec803-4e5a-4c8c-a63d-71241caab628 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:33.893670 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:33.894369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:33.894657 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:33.895376 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:33.904965 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:33.907869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999b9c4-d3e2-4955-b22b-3db04cdc23bd service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:33.918802 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 607/1225] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:43.840645 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=12 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:43.914249 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=15 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:52.755679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978931d6-06a3-4518-9310-23211556513c None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:52.766015 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978931d6-06a3-4518-9310-23211556513c None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:52.770092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:52.770699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:52.770977 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:52.771245 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:52.781302 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:52.784682 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a76032-52a7-45d1-83f2-15645e2e612c service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:52.792818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 619/1226] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:52 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:59.386573 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a73-de53-4f53-a81b-5f9142283f54 None None] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.387111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a73-de53-4f53-a81b-5f9142283f54 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.387111 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca875a73-de53-4f53-a81b-5f9142283f54 None None] PATH_INFO: `/` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.389410 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 608/1227] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:13:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:13:59.400426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9083ae-5550-497a-8240-1e5a409b0ac4 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.400876 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9083ae-5550-497a-8240-1e5a409b0ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.400971 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9083ae-5550-497a-8240-1e5a409b0ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.435165 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-fd9083ae-5550-497a-8240-1e5a409b0ac4 None None] MFA Rules not processed for user `68e13037790741e081d38311378ddbdc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:59.436958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-fd9083ae-5550-497a-8240-1e5a409b0ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:59.457454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 620/1228] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:13:59 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:59.478388 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca875a73-de53-4f53-a81b-5f9142283f54 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:59.511829 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca875a73-de53-4f53-a81b-5f9142283f54 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:59.518386 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:59.519821 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.520527 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.521295 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.535309 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:59.537209 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c07ae-7117-473a-b46f-b4e7230f009b service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:59.549672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 609/1229] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:59 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:09.424473 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=9 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:09.544296 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=6 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:08.549937 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799432-b1b8-4d5b-92c9-17aec3b59f90 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:08.550478 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799432-b1b8-4d5b-92c9-17aec3b59f90 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:08.550569 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22799432-b1b8-4d5b-92c9-17aec3b59f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:08.578609 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-22799432-b1b8-4d5b-92c9-17aec3b59f90 None None] MFA Rules not processed for user `1a2765e2c74e4d34b5208fb3d3f11d42`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:08.579853 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-22799432-b1b8-4d5b-92c9-17aec3b59f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:08.602974 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 621/1230] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:15:08 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:18.601016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=15 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:49.803066 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:49.803599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:49.803705 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:49.821964 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] MFA Rules not processed for user `1a2765e2c74e4d34b5208fb3d3f11d42`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:49.823163 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:49.829904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 610/1231] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:15:49 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:50.215079 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f2b0-e72a-4da7-97b8-69265726be09 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:50.215567 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f2b0-e72a-4da7-97b8-69265726be09 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:50.215660 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681f2b0-e72a-4da7-97b8-69265726be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:50.283683 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e681f2b0-e72a-4da7-97b8-69265726be09 None None] MFA Rules not processed for user `7c02350215a147e7aeeeae512c99a7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:50.284902 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e681f2b0-e72a-4da7-97b8-69265726be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:50.316607 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 622/1232] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Aug 18 21:15:50 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:50.327913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:50.338369 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e762bb-a0d1-4d9d-8f63-d45b77813129 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:50.342820 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:50.343431 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:50.343708 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:50.343984 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:50.352220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:50.353723 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:50.361397 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 611/1233] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:15:50 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:00.313919 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=33 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:00.358201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=9 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:11.334281 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc53c-ad91-48b8-983f-576c5ca8da75 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:11.334793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc53c-ad91-48b8-983f-576c5ca8da75 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:11.334885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edc53c-ad91-48b8-983f-576c5ca8da75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:11.353454 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-e2edc53c-ad91-48b8-983f-576c5ca8da75 None None] MFA Rules not processed for user `1a2765e2c74e4d34b5208fb3d3f11d42`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:11.354687 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-e2edc53c-ad91-48b8-983f-576c5ca8da75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:11.361495 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 623/1234] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:16:11 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:13.473281 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:13.507634 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214baefb-ae1b-4374-820a-69a1176de70b service neutron] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:13.512693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:13.513288 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:13.513567 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:13.513875 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:13.522531 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:13.524210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:13.534839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 612/1235] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:21.348293 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:23.530067 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=13 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:17:42.671544 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] REQUEST_METHOD: `POST` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:42.672054 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:42.672162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:42.690534 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.auth.core [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] MFA Rules not processed for user `1a2765e2c74e4d34b5208fb3d3f11d42`. Rule list: `[]` (Enabled: `True`). {{(pid=88586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:17:42.692750 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:42.698444 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 624/1236] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:17:42 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:17:52.685412 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=3 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:17:56.554869 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:56.575533 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad6df-8f47-4fc3-99db-2225c52b4f99 service placement] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:56.580614 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:56.581201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:56.581484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:56.581792 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:56.590117 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:56.591689 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:56.601177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 613/1237] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:56 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:58.126922 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:58.136621 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731424b-3a03-40a7-9bef-f1abece574d3 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:58.143929 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:58.144540 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:58.144818 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:58.145094 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:58.155118 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:58.156561 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:58.166433 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 625/1238] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:58 2022] GET /identity/v3/auth/tokens => generated 2883 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:06.596449 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=10 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:08.161823 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:19.176516 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:19.187358 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806c77-12a5-46fe-a50b-6f5ccad1fae6 service nova] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:19.192371 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:19.192958 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:19.193236 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:19.193653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:19.207210 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:19.208787 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:19.217599 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 614/1239] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:19 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:19.267359 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:19.275840 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2cacf-90f3-4407-ae82-7bd8bcdc6d06 service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:19.281294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:19.281294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:19.281294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:19.281294 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:19.290732 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:19.292159 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:19.302092 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 626/1240] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:19 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:21.335212 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:21.411485 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8261d6b-23ff-4fed-8835-368996135565 service nova] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:21.416216 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e6c53c1c9519490f854adc67392e28d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:21.416801 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:21.417220 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:21.417784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:21.431303 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:21.434481 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef32194-c73d-4d9f-883e-33dfd20fb582 service cinder] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:21.444903 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 615/1241] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:21 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:29.297824 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:31.439351 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=36 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:35.296123 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:35.306673 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c30be-7160-4427-a225-3c27533340e1 service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:35.311944 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:35.312538 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:35.312816 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:35.313087 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:35.321963 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:35.323617 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:35.334679 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 627/1242] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:35 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:45.329867 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:46.990323 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:46.990890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:46.990890 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:47.011693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] MFA Rules not processed for user `769ff5837a9d4a6b8d8a7aa2751c1114`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:18:47.017554 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:18:47.020314 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 616/1243] 10.222.0.26 () {58 vars in 958 bytes} [Thu Aug 18 21:18:46 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:18:47.278598 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:47.288713 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c305a5-b605-44b8-8918-601ea47e5829 service nova] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:47.292278 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:47.292865 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:47.293141 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:47.293413 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:47.300565 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:47.302029 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:47.310918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 628/1244] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:47 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:47.700823 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:47.713753 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf431c-7986-4a25-bf43-873d6441155d None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:47.718754 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:47.719368 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:47.719645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:47.720035 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:47.728538 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:47.730151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:47.740363 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 617/1245] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:47 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:18:57.306553 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:57.735891 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=9 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:57.875794 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:57.885442 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b5111-7c6e-4fe9-a041-07004f6840ea service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:57.889115 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:57.889743 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:57.890021 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:57.890316 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:57.898157 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:57.899657 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:57.909359 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 629/1246] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:57 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:06.910828 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:06.922335 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50e1be-8788-460e-8bd7-785f3b3d3c21 service placement] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:06.927361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:06.932433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:06.932433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:06.932433 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:06.944131 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:06.947151 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:06.961774 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 618/1247] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:06 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:07.904749 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:16.957588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=6 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:18.556419 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:18.564781 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17a5e3a-1044-4ccc-a33b-1fc62a39a867 service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:18.568478 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:18.569062 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:18.569336 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:18.569601 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:18.579269 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:18.580684 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:18.590481 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 630/1248] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:18 2022] GET /identity/v3/auth/tokens => generated 2889 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:20.766167 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:20.777177 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09232644-7152-405c-bb27-e89991a8c37e service nova] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:20.782587 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68e13037790741e081d38311378ddbdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:20.783202 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:20.783479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:20.786537 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:20.793793 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:20.795752 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:20.807913 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 619/1249] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:20 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:19:28.585879 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=6 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:30.802674 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=6 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:22.598010 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:22.609958 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c149c5f-29b5-4d47-a8a7-809766d8cff4 service neutron] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:22.615089 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:22.615692 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:22.615970 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:22.616244 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:22.618162 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:21:22.644143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:22.644143 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4033d-d60a-4394-8d0a-f0bf3f78beb9 service placement] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:22.655191 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 631/1250] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:21:22 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:21:31.995648 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:32.004904 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec99d9-37bf-4c60-becd-d98433449148 service nova] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:32.009645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:32.009645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:32.009645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:32.009645 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:32.084800 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:32.086264 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8501b3-fdd8-4267-8a85-5f3f96dcfa22 service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:32.104743 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 620/1251] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:21:31 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:21:32.650097 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=11 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:35.734767 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:35.735409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:35.735409 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:35.736961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 632/1252] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:21:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:21:35.765879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:35.766354 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:35.766461 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:35.803734 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:21:35.804928 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:21:35.814029 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 621/1253] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:21:35 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:21:35.824697 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:35.826533 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:21:35.842354 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2fb77-d76c-47e3-a0fb-1f0c1ab6c3e5 None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:35.847613 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:35.848198 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:35.848476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:35.848748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:35.857720 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:35.859298 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:35.870359 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 633/1254] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:21:35 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:21:39.660295 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:39.672653 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba6b7a-9257-46ec-8745-7ebc270c46ed None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:39.677477 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:39.678150 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:39.678428 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:39.678699 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] PATH_INFO: `/v3/users/1a2765e2c74e4d34b5208fb3d3f11d42` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:39.679832 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2765e2c74e4d34b5208fb3d3f11d42)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:39.681811 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:39.854839 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2765e2c74e4d34b5208fb3d3f11d42'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:39.862008 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2765e2c74e4d34b5208fb3d3f11d42'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:39.862658 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2765e2c74e4d34b5208fb3d3f11d42'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:39.922201 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2765e2c74e4d34b5208fb3d3f11d42'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:39.922812 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2765e2c74e4d34b5208fb3d3f11d42'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:39.939833 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 622/1255] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Aug 18 21:21:39 2022] DELETE /identity/v3/users/1a2765e2c74e4d34b5208fb3d3f11d42 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:21:40.179250 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:40.189526 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e74e5-3677-42b5-92e2-caaca6457d56 service placement] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:40.248339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:40.248961 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:40.249238 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:40.249506 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] PATH_INFO: `/v3/projects/7cc736229d024d57be92f66ce0c3ec85` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:40.250653 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc736229d024d57be92f66ce0c3ec85)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:40.252599 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:40.353016 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc736229d024d57be92f66ce0c3ec85', 'request_id': 'req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.358463 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc736229d024d57be92f66ce0c3ec85', 'request_id': 'req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.364602 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc736229d024d57be92f66ce0c3ec85', 'request_id': 'req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.490714 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] The token cache is being invalidate because project 7cc736229d024d57be92f66ce0c3ec85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:21:40.491002 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.491641 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.493117 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 634/1256] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Aug 18 21:21:40 2022] DELETE /identity/v3/projects/7cc736229d024d57be92f66ce0c3ec85 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:21:40.497819 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:40.499484 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:21:40.512275 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752d2a-c6bf-41f0-b936-451610451085 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:40.537446 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:40.566693 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:40.567311 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:40.567588 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:40.567857 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] PATH_INFO: `/v3/users/56a14ebd02f64ed199b6946b5043c1fe` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:40.568948 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a14ebd02f64ed199b6946b5043c1fe)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:40.570879 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:40.731805 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a14ebd02f64ed199b6946b5043c1fe'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.738233 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a14ebd02f64ed199b6946b5043c1fe'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.738891 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a14ebd02f64ed199b6946b5043c1fe'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.798334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a14ebd02f64ed199b6946b5043c1fe'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.798962 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a14ebd02f64ed199b6946b5043c1fe'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:40.818149 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 623/1257] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Aug 18 21:21:40 2022] DELETE /identity/v3/users/56a14ebd02f64ed199b6946b5043c1fe => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:21:41.079992 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:21:41.081426 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:21:41.094968 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5a726-e9aa-4ce0-a818-9670d6cc2910 admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:21:41.156625 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:21:41.157253 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:21:41.157537 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:21:41.157842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] PATH_INFO: `/v3/projects/60398bb3d31f46c3b91753a46f0948fc` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:21:41.158966 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60398bb3d31f46c3b91753a46f0948fc)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:21:41.160884 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:21:41.168934 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:41.293814 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60398bb3d31f46c3b91753a46f0948fc', 'request_id': 'req-2b794117-40ea-403c-8abf-ba85de79e5e9'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:41.299277 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60398bb3d31f46c3b91753a46f0948fc', 'request_id': 'req-2b794117-40ea-403c-8abf-ba85de79e5e9'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:41.305406 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60398bb3d31f46c3b91753a46f0948fc', 'request_id': 'req-2b794117-40ea-403c-8abf-ba85de79e5e9'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:41.413057 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] The token cache is being invalidate because project 60398bb3d31f46c3b91753a46f0948fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:21:41.413348 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:41.413979 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-2b794117-40ea-403c-8abf-ba85de79e5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:21:41.415729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 635/1258] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Aug 18 21:21:41 2022] DELETE /identity/v3/projects/60398bb3d31f46c3b91753a46f0948fc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:21:50.814608 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=40,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:51.409938 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:00.485197 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:00.486647 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:00.547975 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54746c55-769c-4a34-9458-d18517298ec6 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:00.595745 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7c02350215a147e7aeeeae512c99a7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:00.596269 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] REQUEST_METHOD: `GET` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:00.596544 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:00.596856 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:00.598589 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:00.658863 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:00.660320 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eafef70-b5c5-419d-a2d2-4a155003a5ca service neutron] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:00.669764 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 624/1259] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:00 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:04.312514 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:04.313001 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:04.313230 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] PATH_INFO: `/` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:04.314696 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 636/1260] 10.222.0.26 () {54 vars in 921 bytes} [Thu Aug 18 21:22:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:22:04.323776 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] REQUEST_METHOD: `POST` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:04.324218 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:04.324316 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:04.348973 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.auth.core [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] MFA Rules not processed for user `2d082f8a806542a3a3aac3e11055a9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88585) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:22:04.350343 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:04.413090 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 625/1261] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Aug 18 21:22:04 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:22:04.424500 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:04.426209 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:04.446009 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf29a1-c3b9-4328-b26e-4b767d75149e None None] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:04.452114 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d082f8a806542a3a3aac3e11055a9e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '827bfda051654edd9446aae79c093444', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:04.452724 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] REQUEST_METHOD: `GET` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:04.453070 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:04.453461 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:04.462918 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:04.464674 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:04.475623 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 637/1262] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Aug 18 21:22:04 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:22:08.121055 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:08.122564 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:08.132108 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=100 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:08.138090 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643f3d3-97ce-44b7-9f31-7e76fbe30745 None None] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:08.143078 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:08.143702 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:08.143980 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:08.144252 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] PATH_INFO: `/v3/users/769ff5837a9d4a6b8d8a7aa2751c1114` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:08.145361 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769ff5837a9d4a6b8d8a7aa2751c1114)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:08.147322 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:08.312784 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769ff5837a9d4a6b8d8a7aa2751c1114'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.319545 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769ff5837a9d4a6b8d8a7aa2751c1114'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.320207 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769ff5837a9d4a6b8d8a7aa2751c1114'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.386555 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769ff5837a9d4a6b8d8a7aa2751c1114'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.387200 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769ff5837a9d4a6b8d8a7aa2751c1114'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.404842 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 626/1263] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Aug 18 21:22:08 2022] DELETE /identity/v3/users/769ff5837a9d4a6b8d8a7aa2751c1114 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:08.651842 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:08.663260 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680a5ce-ed8c-49ea-85b7-e798778128d7 service placement] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:08.719223 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:08.719849 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:08.720126 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:08.720394 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] PATH_INFO: `/v3/projects/91a161471cfb475693948d252c2766d4` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:08.721525 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a161471cfb475693948d252c2766d4)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:08.723475 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:08.842022 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a161471cfb475693948d252c2766d4', 'request_id': 'req-6a0a525c-5385-4a1f-8648-4505669d2cb5'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.848011 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a161471cfb475693948d252c2766d4', 'request_id': 'req-6a0a525c-5385-4a1f-8648-4505669d2cb5'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.854148 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a161471cfb475693948d252c2766d4', 'request_id': 'req-6a0a525c-5385-4a1f-8648-4505669d2cb5'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.929425 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] The token cache is being invalidate because project 91a161471cfb475693948d252c2766d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:22:08.929729 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.930339 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:08.931805 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 638/1264] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Aug 18 21:22:08 2022] DELETE /identity/v3/projects/91a161471cfb475693948d252c2766d4 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:08.935899 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Authenticating user token {{(pid=88585) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:08.937886 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.fernet_utils [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88585) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:08.950788 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef935-43e7-4a7e-98aa-9746a696de21 admin admin] Validating token access rules against request {{(pid=88585) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:09.005479 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88585) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:09.006126 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:09.006406 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:09.006676 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] PATH_INFO: `/v3/users/9823075240a8425f871e1a3a877e2240` {{(pid=88585) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:09.007782 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9823075240a8425f871e1a3a877e2240)` {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:09.009731 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] RBAC: Authorization granted {{(pid=88585) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:09.194807 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9823075240a8425f871e1a3a877e2240'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.201635 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9823075240a8425f871e1a3a877e2240'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.202429 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9823075240a8425f871e1a3a877e2240'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.266738 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9823075240a8425f871e1a3a877e2240'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.267345 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG keystone.notifications [None req-cbbbba07-fc95-4a7d-b342-91829796e2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9823075240a8425f871e1a3a877e2240'} {{(pid=88585) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.277169 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:09.284334 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: [pid: 88585|app: 0|req: 627/1265] 10.222.0.26 () {58 vars in 1224 bytes} [Thu Aug 18 21:22:08 2022] DELETE /identity/v3/users/9823075240a8425f871e1a3a877e2240 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:09.532326 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Authenticating user token {{(pid=88586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:22:09.533885 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.fernet_utils [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:22:09.547711 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a525c-5385-4a1f-8648-4505669d2cb5 admin admin] Validating token access rules against request {{(pid=88586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:22:09.606852 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b130916f4b143099f2974e99dac365a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'adeaf2e8d52b44768681465c037dfd4a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:22:09.607476 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:22:09.607748 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:22:09.608018 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] PATH_INFO: `/v3/projects/2ebff5dd31d64609854177aebf72a5b9` {{(pid=88586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:22:09.609142 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebff5dd31d64609854177aebf72a5b9)` {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:22:09.611064 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] RBAC: Authorization granted {{(pid=88586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:22:09.630964 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:09.700907 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebff5dd31d64609854177aebf72a5b9', 'request_id': 'req-8fc865be-a161-4cb0-80a3-c08b91583054'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.706931 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebff5dd31d64609854177aebf72a5b9', 'request_id': 'req-8fc865be-a161-4cb0-80a3-c08b91583054'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.713369 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebff5dd31d64609854177aebf72a5b9', 'request_id': 'req-8fc865be-a161-4cb0-80a3-c08b91583054'} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.769383 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] The token cache is being invalidate because project 2ebff5dd31d64609854177aebf72a5b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:22:09.769699 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.770320 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG keystone.notifications [None req-8fc865be-a161-4cb0-80a3-c08b91583054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:22:09.771793 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: [pid: 88586|app: 0|req: 639/1266] 10.222.0.26 () {58 vars in 1233 bytes} [Thu Aug 18 21:22:09 2022] DELETE /identity/v3/projects/2ebff5dd31d64609854177aebf72a5b9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:22:19.432672 dv-osbrick-849017-5-ceph devstack@keystone.service[88585]: DEBUG dbcounter [-] [88585] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=88585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:22:19.766405 dv-osbrick-849017-5-ceph devstack@keystone.service[88586]: DEBUG dbcounter [-] [88586] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}